CN112272019A - Control method and device for sound-control knocking switch, household appliance and storage medium - Google Patents
Control method and device for sound-control knocking switch, household appliance and storage medium Download PDFInfo
- Publication number
- CN112272019A CN112272019A CN202011137445.6A CN202011137445A CN112272019A CN 112272019 A CN112272019 A CN 112272019A CN 202011137445 A CN202011137445 A CN 202011137445A CN 112272019 A CN112272019 A CN 112272019A
- Authority
- CN
- China
- Prior art keywords
- knocking
- switch
- control
- voice
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000005236 sound signal Effects 0.000 claims abstract description 135
- 238000012545 processing Methods 0.000 claims abstract description 33
- 238000012549 training Methods 0.000 claims description 24
- 238000012706 support-vector machine Methods 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 4
- 238000005070 sampling Methods 0.000 claims description 4
- 230000008859 change Effects 0.000 abstract description 23
- 238000010079 rubber tapping Methods 0.000 description 19
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- 239000007787 solid Substances 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 229910003460 diamond Inorganic materials 0.000 description 2
- 239000010432 diamond Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 150000002739 metals Chemical class 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03K—PULSE TECHNIQUE
- H03K17/00—Electronic switching or gating, i.e. not by contact-making and –breaking
- H03K17/94—Electronic switching or gating, i.e. not by contact-making and –breaking characterised by the way in which the control signals are generated
Landscapes
- Combined Controls Of Internal Combustion Engines (AREA)
Abstract
The invention discloses a control method and a control device of a sound control knocking switch, a household appliance and a storage medium, wherein the control device comprises: the sound sensor is used for acquiring an audio signal generated by the sound-controlled knocking switch; and the control processing part is connected with the sound sensor and is used for controlling the on or off of the sound control knocking switch according to the zero crossing rate and the short-time energy of the audio signal. According to the method, the sound sensor is used for acquiring an audio signal generated after the sound control knocking switch is knocked, the principle that the zero crossing rate of the acquired audio signal changes along with the change of a knocking area and the principle that the short-time energy of the acquired audio signal changes along with the change of knocking force is utilized, the control processing part is used for respectively determining the knocking area and the knocking force according to the zero crossing rate and the short-time energy of the audio signal, the on-off of the sound control knocking switch is controlled more accurately, and the false triggering of the sound control knocking switch is reduced. The implementation of the invention can be widely applied to the technical field of electronic switch control.
Description
Technical Field
The invention relates to the technical field of electronic switch control, in particular to a control method and device of a voice-operated knocking switch, a household appliance and a storage medium.
Background
At present, a general household appliance can realize the on-off action through an on-off button on a remote controller or a touch panel. In order to improve the convenience of controlling the household appliance, a piezoelectric sensor arranged in a knocking switch is used for detecting the deformation of a panel of the knocking switch so as to detect a knocking event in the related technology, and then the on-off operation of the household appliance is realized according to the detection result of the knocking event. In this way, on one hand, false triggering caused by false collision is easy to happen; on the other hand, when the switch panel is knocked, corresponding deformation is generated along with temperature change or time lapse, so that the piezoelectric sensor receives an error signal, and the probability of false triggering is further increased.
Disclosure of Invention
In view of the above, an object of the embodiments of the present invention is to provide a method and an apparatus for controlling a sound-controlled tap switch, a household electrical appliance, and a storage medium, which can reduce false triggering operations of turning on or off the tap switch.
According to an embodiment of a first aspect of the present invention, there is provided a control device for a voice-activated tap switch, the control device including:
the sound sensor is used for acquiring an audio signal generated by the sound-controlled knocking switch;
and the control processing part is connected with the sound sensor and is used for controlling the on or off of the sound control knocking switch according to the zero crossing rate and the short-time energy of the audio signal.
The control device according to the embodiment of the invention has at least the following beneficial effects: according to the sound control knocking switch, the audio signals generated after the sound control knocking switch is knocked are obtained through the sound sensor, the knocking area and the knocking strength can be respectively determined by the control processing part according to the zero-crossing rate and the short-time energy of the audio signals by utilizing the principle that the zero-crossing rate of the obtained audio signals changes along with the change of the knocking area and the principle that the short-time energy of the obtained audio signals changes along with the change of the knocking strength, and then the opening or closing of the sound control knocking switch is controlled more accurately, so that the false triggering of the sound control knocking switch is reduced.
Optionally, the voice-operated knocking switch is provided with a panel, and the voice sensor is installed in the center of the panel. The sound sensor is arranged at the center of the panel, audio signals acquired from all directions at the center are more uniform, the strength is higher, the presented rule is more obvious, the subsequent audio signals are more accurately and simply processed, and the false triggering operation of the sound control knocking switch is further reduced.
Optionally, the voice-operated knocking switch is provided with a panel, the panel is divided into an effective knocking area and an ineffective knocking area, and the sound sensor is installed in the center of the effective knocking area. The knocking in the range of the effective knocking area is easier to identify, and the knocking in the range of the ineffective knocking area is not easy to identify, so that the false triggering operation caused by the ineffective knocking area is further reduced; the sound sensor is arranged at the center of the effective knocking area, audio signals acquired from all directions at the center are more uniform, the strength is higher, the presented rule is more obvious, the subsequent audio signals are more accurately and simply processed, and the false triggering operation of the sound control knocking switch is further reduced.
Optionally, the sound sensor is attached to the back of the sound-controlled tap switch panel. The sound sensor is tightly attached to the back of the sound control knocking switch panel, under the condition, the sound sensor receives audio signals in a solid conduction mode, and the sound control knocking switch panel is not required to be provided with a honeycomb receiving hole, so that the received audio signals are not distorted as much as possible, and meanwhile, the integrity and the attractiveness of the sound control knocking switch panel can be kept.
Optionally, the control device further comprises:
and the vibration sensor is connected with the control processing part and is used for acquiring a vibration signal generated by the voice-operated knocking switch.
Whether the sound control knocking switch panel vibrates or not is detected through the vibration sensor, the fact that the audio signals are from the sound control knocking switch panel is determined, false triggering caused by the audio signals generated by other sound sources except the sound control knocking switch panel is reduced, and false triggering operation is further reduced.
According to a second aspect of the present invention, there is provided a control method for a voice-controlled tap switch, the control method including:
acquiring an audio signal detected by the sound sensor;
determining zero crossing rate and short-time energy according to the audio signal;
and controlling the sound control knocking switch to be turned on or off according to the zero crossing rate and the short-time energy.
The control method provided by the embodiment of the invention has at least the following beneficial effects: when the voice-operated knocking switch is knocked, the voice sensor receives an audio signal generated by knocking of the voice-operated knocking switch, and determines the knocking area and the knocking strength according to the zero-crossing rate and the short-time energy of the audio signal by utilizing the principle that the zero-crossing rate of the obtained audio signal changes along with the change of the knocking area and the principle that the short-time energy of the obtained audio signal changes along with the change of the knocking strength, so that the opening or closing of the voice-operated knocking switch is controlled more accurately, and the false triggering operation is reduced.
Optionally, the controlling the on or off of the voice-operated knock switch according to the zero crossing rate and the short-time energy includes:
inputting the zero crossing rate and the short-time energy into a preset audio classifier to obtain a classification result of whether the audio signal is an effective signal;
and when the classification result is that the audio signal is an effective signal, controlling the on or off of the voice-operated knocking switch.
Whether the audio signal is an effective signal is determined by adopting a preset audio classifier, and the preset audio classifier is obtained by training and learning according to training data of a known classification result, so that the method is applicable to the condition that the classification rule is obvious or not, wider in application range and more accurate in result.
Optionally, the preset audio classifier is constructed by:
collecting and marking the audio signal of the voice-operated knocking switch to obtain a data collecting sample;
and taking the zero crossing rate and the short-time energy of the audio signal as input parameters of training, and training the data sampling sample by adopting a support vector machine to construct and obtain the preset audio classifier.
The data sampling samples are trained by adopting a support vector machine method, and when the training samples of the audio signals are relatively few or present linear irresistibility, a more accurate training result can be obtained.
Optionally, the control method further includes:
and controlling the sound control knocking switch to be turned on or off according to the times of the effective signals and the time interval of the effective signals.
By increasing the number of times of detecting the effective signals and limiting the time interval of the effective signals, the false triggering operation caused by false collision is further reduced.
Optionally, the determining the zero-crossing rate and the short-time energy according to the audio signal includes:
acquiring a vibration signal detected by a vibration sensor;
and when the amplitude of the vibration signal exceeds a preset amplitude value, determining the zero crossing rate and the short-time energy according to the audio signal.
When the sound-control knocking switch is knocked, the vibration sensor and the sound sensor respectively receive a vibration signal and an audio signal generated by the sound-control knocking switch due to knocking, when the amplitude of the vibration signal is larger than a preset amplitude value, the fact that knocking occurs in a panel area or an effective knocking area of the sound-control knocking switch is indicated, then the sound-control knocking switch is controlled to be turned on or turned off according to the zero crossing rate and short-term energy of the audio signal, and the false start operation of the sound-control knocking switch caused by the audio signal generated by a sound source in an area except the sound-control knocking switch panel is reduced; when the amplitude of the vibration signal is smaller than the preset amplitude, the knocking occurs outside the panel area of the voice-operated knocking switch or the effective knocking area, subsequent operation is not executed, namely the voice-operated knocking switch is not required to be controlled to be turned on or turned off according to the zero crossing rate and the short-time energy of the audio signal, the execution process is simple, and the operation is easy.
According to a third aspect of the present invention, there is provided a control device for a voice-activated tap switch, including: the control method comprises a memory, a control processor and a computer program stored on the memory and capable of running on the control processor, wherein the control processor realizes the control method of the second aspect embodiment when executing the computer program.
The control device according to the embodiment of the invention has at least the following beneficial effects: according to the sound control knocking switch, the audio signals generated after the sound control knocking switch is knocked are obtained through the sound sensor, the knocking area and the knocking strength can be respectively determined by the control processing part according to the zero-crossing rate and the short-time energy of the audio signals by utilizing the principle that the zero-crossing rate of the obtained audio signals changes along with the change of the knocking area and the principle that the short-time energy of the obtained audio signals changes along with the change of the knocking strength, and then the opening or closing of the sound control knocking switch is controlled more accurately, so that the false triggering of the sound control knocking switch is reduced.
According to a fourth aspect of the present invention, there is provided a household appliance, comprising the control device of the first aspect or the control device of the third aspect.
The household appliance provided by the embodiment of the invention at least has the following beneficial effects: according to the sound control knocking switch, the audio signals generated after the sound control knocking switch is knocked are obtained through the sound sensor, the knocking area and the knocking strength can be respectively determined by the control processing part according to the zero-crossing rate and the short-time energy of the audio signals by utilizing the principle that the zero-crossing rate of the obtained audio signals changes along with the change of the knocking area and the principle that the short-time energy of the obtained audio signals changes along with the change of the knocking strength, and then the opening or closing of the sound control knocking switch is controlled more accurately, so that the false triggering of the sound control knocking switch is reduced.
According to a fifth aspect of the present invention, there is provided a computer-readable storage medium storing a computer-executable program for causing a computer to execute the control method according to the second aspect.
Through executing a program executable by a processor, an audio signal generated after the sound control knocking switch is knocked is obtained according to a sound sensor, the knocking area and the knocking force can be respectively determined by a control processing part according to the zero-crossing rate and the short-time energy of the audio signal by utilizing the principle that the zero-crossing rate of the obtained audio signal changes along with the change of the knocking area and the principle that the short-time energy of the obtained audio signal changes along with the change of the knocking force, and then the opening or closing of the sound control knocking switch is more accurately controlled, so that the false triggering of the sound control knocking switch is reduced.
Drawings
FIG. 1 is a schematic structural diagram of a control device according to an embodiment of the present invention;
FIG. 2 is a schematic view showing another structure of a control device according to an embodiment of the present invention;
FIG. 3 is a schematic view showing another structure of a control device according to an embodiment of the present invention;
FIG. 4 is a flow chart of one step in a control method of an embodiment of the present invention;
FIG. 5 is a flowchart illustrating a step of controlling the opening or closing of the voice-activated tap switch according to the zero-crossing rate and the short-term energy in the control method according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating another step of controlling the opening or closing of the voice-activated tap switch according to the zero-crossing rate and the short-term energy in the control method according to the embodiment of the invention;
FIG. 7 is a flowchart illustrating a step of constructing a pre-defined classifier according to a control method of an embodiment of the present invention;
FIG. 8 is a flow chart of another step in a control method of an embodiment of the present invention;
FIG. 9 is a schematic view showing another structure of a control device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a household appliance according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
In the description of the present invention, it should be understood that the orientation or positional relationship referred to in the description of the orientation, such as the upper, lower, front, rear, left, right, etc., is based on the orientation or positional relationship shown in the drawings, and is only for convenience of description and simplification of description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention.
In the description of the present invention, the meaning of a plurality of means is one or more, and the meaning of a plurality of means is two or more, and larger, smaller, larger, etc. are understood to exclude the essential numbers. If there is a description to first, second, third etc. for the purpose of distinguishing between technical features, it is not intended to indicate or imply relative importance or to implicitly indicate the number of technical features indicated or to implicitly indicate the precedence of technical features indicated.
In the description of the present invention, unless otherwise explicitly limited, terms such as arrangement, installation, connection and the like should be understood in a broad sense, and those skilled in the art can reasonably determine the specific meanings of the above terms in the present invention in combination with the specific contents of the technical solutions.
The embodiment of the invention provides a control method and a control device of a voice-operated knocking switch and a household appliance. The control device includes: the sound sensor is used for acquiring an audio signal generated by the sound-controlled knocking switch; and the control processing part is connected with the sound sensor and is used for controlling the on or off of the sound control knocking switch according to the zero crossing rate and the short-time energy of the audio signal. The household appliance is provided with the sound sensor, the sound sensor is utilized to receive the audio signal generated by the sound control knocking switch, under the condition, the control processing part utilizes the principle that the zero-crossing rate of the obtained audio signal changes along with the change of the knocking area and the short-time energy of the obtained audio signal changes along with the change of the knocking force, the knocking area and the knocking force can be respectively determined according to the zero-crossing rate and the short-time energy of the audio signal, so that the household appliance is controlled to be opened or closed more accurately, and the false triggering of the sound control knocking switch is reduced. Wherein, the zero crossing rate refers to the number of times that the audio signal passes through the zero point, namely, the number of times that the audio signal changes from positive to negative or from negative to positive; the short-term energy refers to the energy of the audio signal in a short time, and the short time is usually one frame, i.e. the short-term energy represents the energy of the audio signal in one frame time. The embodiments of the present invention will be further explained with reference to the drawings.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a control device 110 of a voice-activated tap switch according to an embodiment of the present invention. The control device 110 of the voice-controlled knocking switch comprises a voice sensor 112 and a control processing part 111, wherein the voice sensor 112 is installed on the voice-controlled knocking switch 120, and the voice sensor 112 is connected with the control processing part 111.
It should be noted that the sound sensor 112 may be installed on different positions on the front surface of the panel of the voice-controlled tapping switch 120, or may be installed on different positions on the back surface of the panel of the voice-controlled tapping switch 120, and the embodiment is not particularly limited thereto.
It will be understood by those skilled in the art that the sound sensor 112 may be a microphone sensor, or may be a sound wave wireless receiver, and the present embodiment is not limited thereto.
It should be noted that the control processing unit 111 may be electrically connected to the sound sensor 112, or may be wirelessly connected, and this embodiment is not particularly limited thereto.
It will be understood by those skilled in the art that the control processing part 111 may be a stand-alone device or a module device used in cooperation with a home appliance. When the control processing part 111 is a separate device, the control processing part 111 may be wirelessly connected with the sound sensor 112, and when the control processing part 111 is provided on the home appliance, the control processing part 111 may be electrically connected with the sound sensor 112.
The sound sensor 112 is installed on the sound-controlled knocking switch 120, and an audio signal generated after the sound-controlled knocking switch 120 is knocked is acquired by using the sound sensor 112; the control processing part 111 can respectively determine the knocking area and the knocking strength according to the zero crossing rate and the short-time energy of the audio signal by using the principle that the zero crossing rate of the acquired audio signal changes along with the change of the knocking area and the principle that the short-time energy of the acquired audio signal changes along with the change of the knocking strength, so that the on or off of the voice-operated knocking switch 120 is controlled more accurately, and the false triggering of the voice-operated knocking switch is reduced.
Optionally, the voice-operated tapping switch 120 is provided with a panel, the sound sensor 112 is installed at the center of the panel of the voice-operated tapping switch 120, and the shape of the panel of the voice-operated tapping switch 120 may be regular, such as a circle, a square, a diamond, etc., or irregular. The sound sensor 112 is installed at the center of the panel of the sound-control knocking switch 120, so that the audio signals acquired from all directions at the center are more uniform, the intensity is higher, the presented rule is more obvious, the subsequent audio signals are more accurately and simply processed, and the false triggering operation of the sound-control knocking switch 120 is further reduced. The panel of the sound control knocking switch 120 is set to be in a regular shape, so that audio signals generated by knocking on the panel of the sound control knocking switch 120 are distributed more uniformly, the subsequent audio signals are processed more accurately, and the false triggering operation is further reduced.
Optionally, voice-activated tap switch 120 is provided with a faceplate, and sound sensor 112 is affixed to the back of the faceplate of voice-activated tap switch 120. In this case, the sound sensor 112 receives the audio signal generated by the knocking of the sound-controlled knocking switch 120 through solid conduction, and the panel of the sound-controlled knocking switch 120 does not need to be provided with a honeycomb-shaped receiving hole, so that the received audio signal is not distorted as much as possible, and the integrity and the aesthetic property of the panel of the sound-controlled knocking switch 120 are maintained.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a control device 110 of a voice-activated tap switch according to another embodiment of the present invention. The voice-controlled knocking switch 120 is provided with a panel, the sound sensor 112 is installed on the panel of the voice-controlled knocking switch 120, the panel of the voice-controlled knocking switch 120 is divided into an effective knocking area 121 and an ineffective knocking area 122, and the rest of the panel of the voice-controlled knocking switch 120 except the effective knocking area 121 is the ineffective knocking area 122; the acoustic sensor 112 is installed at the center of the effective tapping area 121.
It should be noted that the shape of the effective tapping area 121 is not limited, and may be a regular shape or an irregular shape, and the regular shape includes a square, a rectangle, a diamond, a circle, and the like; the effective knocking area 121 is set to be in a regular shape, so that audio signals generated by knocking in the effective knocking area 121 are distributed more uniformly, the subsequent audio signals are processed more accurately, and the false triggering is further reduced; if the effective knocking area 121 is set to be circular, the audio signals generated by the same knocking at the same position in different directions and at the same distance from the center of the circle have the same size, and the presented rule is more obvious.
Taps within the range of the effective tap region 121 are more easily recognized, and taps within the range of the ineffective tap region 122 are less easily recognized, thereby further reducing false triggering operations caused by the ineffective tap region 122; the sound sensor 112 is installed at the center of the effective knocking area 121, so that the audio signals acquired from all directions at the center are more uniform, the intensity is higher, the presentation rule is more obvious, the subsequent audio signals are more accurately and simply processed, and the false triggering operation of the sound control knocking switch 120 is further reduced.
Alternatively, the sound sensor 112 may be held against the back of the active tap region 121. In this case, the sound sensor 112 receives the audio signal generated by the knocking of the sound-control knocking region 121 through solid conduction, and the panel of the sound-control knocking switch 120 does not need to be provided with a honeycomb-shaped receiving hole, so that the received audio signal is not distorted as much as possible, and the integrity and the aesthetic property of the panel of the sound-control knocking switch 120 are maintained.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a control device 110 of a voice-activated tap switch according to another embodiment of the present invention. The control device 110 of the voice-controlled knocking switch 120 comprises a sound sensor 112, a vibration sensor 113 and a control processing part 111, the voice-controlled knocking switch 120 is provided with a panel, the sound sensor 112 and the vibration sensor 113 are both arranged on the panel of the voice-controlled knocking switch 120, and the sound sensor 112 and the vibration sensor 113 are both connected with the control processing part 111.
It should be noted that the sound sensor 112 and the vibration sensor 113 may be installed at different positions on the front surface of the panel of the voice-operated tapping switch 120, or may be installed at different positions on the back surface of the panel of the voice-operated tapping switch 120, and the embodiment is not particularly limited thereto.
It will be understood by those skilled in the art that the sound sensor 112 may be a microphone sensor, or may be a sound wave wireless receiver, and the present embodiment is not limited thereto. The vibration sensor 113 may be an angular velocity sensor, such as a gyroscope, or may be a displacement sensor, and this embodiment is not particularly limited thereto.
The control processing unit 111 may be electrically connected to the sound sensor 112 and the vibration sensor 113, or may be wirelessly connected to the sound sensor and the vibration sensor, and the present embodiment is not particularly limited thereto.
It will be understood by those skilled in the art that the control processing part 111 may be a stand-alone device or a module device used in cooperation with a home appliance. When the control processing part 111 is a separate device, the control processing part 111 may be wirelessly connected with the sound sensor 112 and the vibration sensor 113, and when the control processing part 111 is provided on the home appliance, the control processing part 111 may be electrically connected with the sound sensor 112 and the vibration sensor 113.
The vibration sensor 113 is installed on the panel of the sound control knocking switch 120, whether the panel of the sound control knocking switch 120 vibrates or not is detected by using the vibration sensor 113, and an audio signal is determined to be from the panel of the sound control knocking switch 120, so that false triggering caused by the audio signal generated by other sound sources except the panel of the sound control knocking switch 120 is reduced. A sound sensor 112 is arranged on the panel of the sound-controlled knocking switch 120, and an audio signal generated by the panel of the sound-controlled knocking switch 120 is acquired by using the sound sensor 112; the control processing part 111 can respectively determine the knocking area and the knocking strength according to the zero crossing rate and the short-time energy of the audio signal by using the principle that the zero crossing rate of the acquired audio signal changes along with the change of the knocking area and the principle that the short-time energy of the acquired audio signal changes along with the change of the knocking strength, so that the on or off of the voice-operated knocking switch 120 is controlled more accurately, and the false triggering operation is reduced.
Optionally, the vibration sensor 113 is mounted on the face of the voice activated tap switch 120. The vibration sensor 113 is installed at the center of the panel of the voice-operated knock switch 120 to better detect the vibration generated in each direction, so that the detection result is more accurate.
Optionally, the voice-operated tapping switch 120 is provided with a panel, the panel of the voice-operated tapping switch 120 is divided into an effective tapping area 121 and an ineffective tapping area 122, the rest of the panel of the voice-operated tapping switch 120 except for the effective tapping area 121 is the ineffective tapping area 122, and the vibration sensor 113 is installed at the center position of the effective tapping area 121. Taps within the range of the effective tap region 121 are more easily recognized, and taps within the range of the ineffective tap region 122 are less easily recognized, thereby further reducing false triggering operations caused by the ineffective tap region 122; the vibration sensor 113 is installed at the center of the effective knocking area 121 to better detect the vibration generated in each direction, so that the detection result is more accurate.
Optionally, the vibration sensor 113 is closely attached to the back of the effective knocking area 121, in this case, the vibration sensor 113 receives the vibration signal generated by knocking the voice-operated knocking switch 120 through solid conduction, and the panel of the voice-operated knocking switch 120 does not need to be provided with a honeycomb-shaped receiving hole, so that the intensity of the received vibration signal is as large as possible, and the integrity and the attractiveness of the panel of the voice-operated knocking switch 120 are maintained.
An embodiment of the present invention further provides a control method for a voice-operated tapping switch, which is applied to a control device disposed in a household appliance in the foregoing embodiment, wherein a structure or a component structure of the control device has been described in detail in the foregoing embodiment, and is not described herein again. Referring to fig. 4, the control method according to the embodiment of the present invention includes, but is not limited to, step S110, step S120, and step S130.
Step S110, acquiring an audio signal detected by a sound sensor;
step S120, determining zero crossing rate and short-time energy according to the audio signal;
and S130, controlling the sound control knocking switch to be turned on or off according to the zero crossing rate and the short-time energy.
Step S130 is to perform centering processing on the acquired audio signal, and then perform peak signal extraction on the audio signal after the centering processing to calculate the zero crossing rate and the short-term energy, which can be specifically calculated by the following formulas (1) and (2).
Wherein, sgn [ alpha ], [ alpha ]]Representing a symbolic function, i.e.
ZnDenotes the zero-crossing rate, EnRepresenting short-time energy, N representing the frame length of the audio signal, N representing the number of frames, m representing the number of samples, xn(m) represents the m-th sample value of the n-th frame.
Because the structure and the material of the panel and the back plate of different sound control knocking switches are different, the back of some parts is hollow, and the back of some parts is solid; some panels are planes, and some panels are cambered surfaces; some materials are plastics, some are metals, etc. The zero-crossing rate and the short-time energy of the audio signal generated by different voice-controlled knocking switches can show different rules, so that the method for controlling the on or off of the voice-controlled knocking switch according to the zero-crossing rate and the short-time energy is not limited.
When the voice-operated knocking switch is knocked, the voice sensor receives an audio signal generated by knocking of the voice-operated knocking switch, obtains zero-crossing rate and short-time energy according to the audio signal, and controls the on/off of the voice-operated knocking switch according to the zero-crossing rate and the short-time energy; the principle that the zero crossing rate of the obtained audio signal changes along with the change of the knocking area and the short-time energy of the obtained audio signal changes along with the change of the knocking strength is utilized; the knocking area and the knocking force are respectively determined according to the zero crossing rate and the short-time energy of the audio signal, so that the opening or closing of the voice-operated knocking switch is controlled more accurately, and the false triggering operation is reduced.
Alternatively, as shown in fig. 5, fig. 5 is a step flow diagram of an embodiment of the refinement flow of step S130 in fig. 4, where step S130 includes, but is not limited to, step S1300.
And S1300, when the zero crossing rate is within a preset range and the short-time energy is larger than a preset value, controlling the on or off of the voice-operated knocking switch.
It should be noted that the preset range of the zero-crossing rate and the preset value of the short-time energy need to be determined according to the material and the structure of the voice-operated knocking switch, and this embodiment does not specifically limit this.
When the zero crossing rate of the audio signal received by the sound sensor is linearly changed along with the distance between the knocking point and the sound sensor, the zero crossing rate is in a preset range, namely the distance between the knocking point and the sound sensor is in the preset range; the short-time energy is larger than a preset value, namely the knocking force is larger than a set threshold value; and determining that the knocking distance is within a preset range according to the zero crossing rate, and determining that the knocking force is greater than a set threshold value through the short-time energy being greater than the preset value, so that false triggering operation is reduced.
Alternatively, as shown in fig. 6, fig. 6 is a flowchart of steps of another embodiment of the refinement process of step S130 in fig. 4, and the step S130 includes, but is not limited to, step S1301 and step S1302.
S1301, inputting the zero crossing rate and the short-time energy into a preset audio classifier to obtain a classification result of whether the audio signal is an effective signal;
and S1302, when the audio signal is an effective signal according to the classification result, controlling the sound control knocking switch to be turned on or off.
The preset audio classifier is a prediction model obtained by training according to a certain number of audio signal acquisition samples, and the more the acquisition samples are, the more accurate the prediction result is; the input quantity of the preset audio classifier is the zero crossing rate and the short-time energy of the audio signal, and the output result is an effective signal or an invalid signal. The training method of the preset audio classifier can adopt a machine learning method or a deep learning method, the preset audio classifier can adopt an off-line training method, namely, the training is finished before use, the updating is not carried out in the use process, and the off-line training method is simpler to operate; the preset audio classifier can also adopt an online training method, even if the preset audio classifier is trained before use, the preset audio classifier is continuously updated according to the actual situation in the use process, and the result of the online training method is more accurate.
The zero-crossing rate of the audio signal received by the sound sensor is linearly or nonlinearly changed along with the distance from the knocking point to the sound sensor, and a preset audio classifier can be adopted to determine whether the audio signal is an effective signal or not, so that the opening or closing of the sound control knocking switch is controlled, and the probability of misoperation is reduced. Whether the audio signal is an effective signal is determined by adopting a preset audio classifier, and the preset audio classifier is obtained by training and learning according to training data of a known classification result, so that the method is applicable to the condition that the classification rule is obvious or not, wider in application range and more accurate in result.
Alternatively, as shown in fig. 7, fig. 7 is a flowchart illustrating steps of an embodiment of a preset audio classifier construction method, including, but not limited to, step S210 and step S220.
S210, collecting and marking an audio signal of the voice-operated knocking switch to obtain a data collecting sample;
and S220, training the data acquisition sample by using the zero crossing rate and the short-time energy of the audio signal as input parameters of training and adopting a support vector machine to construct and obtain a preset audio classifier.
Respectively marking the collected audio signals of the voice-operated knocking switch panel as valid audio signals and invalid audio signals according to actual conditions to form a data collection sample; training a data acquisition sample based on a support vector machine, wherein the data acquisition sample is divided into a training sample and a testing sample, the training sample and the testing sample both comprise valid audio signals and invalid audio signal samples, the input quantity is the zero crossing rate and the short-time energy of the audio signals, and the output quantity is valid signals or invalid signals.
The data sampling samples are trained by adopting a support vector machine method, and when the training samples of the audio signals are relatively few or present linear irresistibility, a more accurate training result can be obtained.
Optionally, the sound control knocking switch is controlled to be turned on or off according to the number of the effective signals and the time interval of the effective signals.
It should be noted that the number of valid signals may be 1, 2, or 3, and this embodiment does not specifically limit the number.
The interval time of the effective signal may be 200ms, 300ms, or 500ms, and may be set appropriately according to actual use needs, and this embodiment is not particularly limited thereto.
Optionally, the number of valid signals is set to 2, and the interval time of the valid signals is set to 200 ms; when the effective audio signal is detected, the number of times of the effective signal is set to be 1 and timing is started, the effective audio signal is continuously detected within 200ms, and when the effective signal is not detected within 200ms, the number of times of the effective signal is set to be 0 and detection is restarted; when the effective signal is detected within 200ms, the number of the effective signals is set to 2, and the sound control knocking switch is controlled to be turned on or off.
By increasing the number of times of detecting the effective signals and limiting the time interval of the effective signals, the false triggering operation caused by false collision is further reduced.
Optionally, as shown in fig. 8, fig. 8 is a flowchart illustrating steps of another method for controlling a voice-controlled tapping switch according to an embodiment of the present invention, including, but not limited to, step S310, step S320, and step S330.
Step S310, acquiring a vibration signal detected by a vibration sensor and an audio signal detected by a sound sensor;
step S320, when the amplitude of the vibration signal is larger than a preset amplitude, calculating zero crossing rate and short-term energy according to the audio signal; otherwise, the audio signal is not processed;
and step S330, controlling the on or off of the sound control knocking switch according to the zero crossing rate and the short-time energy.
When the sound-control knocking switch is knocked, the vibration sensor and the sound sensor respectively detect a vibration signal and an audio signal of the sound-control knocking switch, which are generated by knocking, when the amplitude of the vibration signal is larger than a preset amplitude value, the fact that knocking occurs in a panel area or an effective knocking area of the sound-control knocking switch is indicated, then the sound-control knocking switch is controlled to be turned on or turned off according to the zero crossing rate and short-term energy of the audio signal, and the false start operation of the sound-control knocking switch caused by the audio signal generated by a sound source in an area except the sound-control knocking switch panel is reduced; when the amplitude of the vibration signal is smaller than the preset amplitude, the knocking occurs outside the panel area of the voice-operated knocking switch or the effective knocking area, subsequent operation is not executed, namely the voice-operated knocking switch is not required to be controlled to be turned on or turned off according to the zero crossing rate and the short-time energy of the audio signal, the execution process is simple, and the operation is easy.
Referring to fig. 9, fig. 9 is a schematic structural diagram of a control device 110 according to an embodiment of the present invention. The control device 110 according to the embodiment of the present invention is built in a home appliance, and includes one or more control processors 1101 and a memory 1102, and fig. 9 illustrates one control processor 1101 and one memory 1102 as an example.
The control processor 1101 and the memory 1102 may be connected by a bus or other means, such as the bus connection shown in FIG. 9.
The memory 1102, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs as well as non-transitory computer executable programs. Further, the memory 1102 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 1102 may optionally include memory 1102 located remotely from the control processor 1101, and the remote memory 1102 may be coupled to the control device 110 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Those skilled in the art will appreciate that the device configuration shown in fig. 9 does not constitute a limitation of control device 110, and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.
Non-transitory software programs and instructions required to implement the control method applied to the control device 110 in the above-described embodiment are stored in the memory 1102, and when executed by the control processor 1101, perform the control method applied to the control device 110 in the above-described embodiment, for example, perform the method steps S110 to S130 in fig. 4, the method step S1300 in fig. 5, the method steps S1301 and S1302 in fig. 6, and the method steps S210 and S220 in fig. 7 described above.
Referring to fig. 10, fig. 10 is a schematic structural diagram of a household appliance 100 according to an embodiment of the present invention, and the household appliance 100 includes the control device 110 according to the above embodiment. The household appliance 100 includes an air conditioner, a refrigerator, a water heater, a washing machine, and the like, and the embodiment is not particularly limited thereto.
A sound sensor is arranged on a sound control knocking switch panel of the household appliance 100, and the principle that the zero crossing rate of the obtained audio signal changes along with the change of a knocking area and the short-time energy of the obtained audio signal changes along with the change of knocking strength is utilized; the control device 110 can determine the knocking area and the knocking strength according to the zero crossing rate and the short-time energy of the audio signal, so as to more accurately control the on/off of the household appliance 100, thereby reducing the false triggering operation.
A vibration sensor and a sound sensor are arranged on a sound-control knocking switch panel of the household appliance 100, the vibration sensor detects whether the sound-control knocking switch panel region or the effective knocking region vibrates, and determines that an audio signal comes from the sound-control knocking switch panel region or the effective knocking region; when the knocking occurs outside the panel area of the voice-operated knocking switch or outside the effective knocking area, subsequent operation is not executed, namely, the voice-operated knocking switch is not required to be controlled to be turned on or turned off according to the zero crossing rate and the short-time energy of the audio signal, and the execution process is simple and easy to operate.
Since the household appliance 100 in this embodiment has the control device 110 in any embodiment, the household appliance 100 in this embodiment has the hardware structure of the control device 110 in the above embodiment, and the control processor in the control device 110 can call the control program of the household appliance 100 stored in the memory to realize control over the control device 110.
The above-described embodiments of the apparatus are merely illustrative, wherein the units illustrated as separate components may or may not be physically separate, i.e. may be located in one place, or may also be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
Furthermore, an embodiment of the present invention also provides a computer-readable storage medium, which stores a computer-executable program, which is executed by one or more control processors, for example, by one of the control processors 1101 in fig. 9, and can cause the one or more control processors 1101 to execute the control method in the above-described method embodiment, such as executing the above-described method steps S110 to S130 in fig. 4, the method step S1300 in fig. 5, the method steps S1301 and S1302 in fig. 6, and the method step S210 and S220 in fig. 7.
One of ordinary skill in the art will appreciate that all or some of the steps, systems, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
While the preferred embodiments of the present invention have been described in detail, it will be understood by those skilled in the art that the foregoing and various other changes, omissions and deviations in the form and detail thereof may be made without departing from the scope of this invention.
Claims (13)
1. A control device for a voice activated slap switch, the control device comprising:
the sound sensor is used for acquiring an audio signal generated by the sound-controlled knocking switch;
and the control processing part is connected with the sound sensor and is used for controlling the on or off of the sound control knocking switch according to the zero crossing rate and the short-time energy of the audio signal.
2. The control device of a voice-activated slap switch of claim 1, wherein the voice-activated slap switch is provided with a faceplate, and the voice sensor is mounted in a central position of the faceplate.
3. The control device of the voice-operated knock switch according to claim 1, wherein the voice-operated knock switch is provided with a panel divided into an effective knock region and an ineffective knock region, and the voice sensor is installed at a central position of the effective knock region.
4. The control device of a voice activated slap switch as claimed in claim 2 or 3 wherein said voice sensor is affixed to the back of said faceplate.
5. The control device of a voice activated slap switch of claim 1, further comprising:
and the vibration sensor is connected with the control processing part and is used for acquiring a vibration signal generated by the voice-operated knocking switch.
6. A control method of a voice-operated knocking switch is characterized by comprising the following steps:
acquiring an audio signal detected by a sound sensor;
determining zero crossing rate and short-time energy according to the audio signal;
and controlling the sound control knocking switch to be turned on or off according to the zero crossing rate and the short-time energy.
7. The method for controlling the voice-activated slap switch according to claim 6, wherein the controlling the on or off of the voice-activated slap switch according to the zero crossing rate and the short-term energy comprises:
inputting the zero crossing rate and the short-time energy into a preset audio classifier to obtain a classification result of whether the audio signal is an effective signal;
and when the classification result is that the audio signal is an effective signal, controlling the on or off of the voice-operated knocking switch.
8. The method of claim 7, wherein the preset audio classifier is constructed by the steps of:
collecting and marking the audio signal of the voice-operated knocking switch to obtain a data collecting sample;
and taking the zero crossing rate and the short-time energy of the audio signal as input parameters of training, and training the data sampling sample by adopting a support vector machine to construct and obtain the preset audio classifier.
9. The method of controlling a voice activated slap switch of claim 7 further comprising:
and controlling the sound control knocking switch to be turned on or off according to the times of the effective signals and the time interval of the effective signals.
10. The method of claim 6, wherein said determining a zero crossing rate and a short time energy from said audio signal comprises:
acquiring a vibration signal detected by a vibration sensor;
and when the amplitude of the vibration signal exceeds a preset amplitude value, determining the zero crossing rate and the short-time energy according to the audio signal.
11. A control device of a sound control knocking switch is characterized by comprising: memory, control processor and computer program stored on the memory and executable on the control processor, characterized in that the control processor implements the control method according to any one of claims 6 to 10 when executing the computer program.
12. A domestic appliance comprising a control device according to any one of claims 1 to 5 or a control device according to claim 11.
13. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer-executable program for causing a computer to execute the control method according to any one of claims 6 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011137445.6A CN112272019A (en) | 2020-10-22 | 2020-10-22 | Control method and device for sound-control knocking switch, household appliance and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011137445.6A CN112272019A (en) | 2020-10-22 | 2020-10-22 | Control method and device for sound-control knocking switch, household appliance and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112272019A true CN112272019A (en) | 2021-01-26 |
Family
ID=74341544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011137445.6A Pending CN112272019A (en) | 2020-10-22 | 2020-10-22 | Control method and device for sound-control knocking switch, household appliance and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112272019A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102999279A (en) * | 2012-11-29 | 2013-03-27 | 四川长虹电器股份有限公司 | Method for controlling intelligent device through knocks |
| CN103152481A (en) * | 2013-02-27 | 2013-06-12 | 上海斐讯数据通信技术有限公司 | Mobile terminal voice time-indicating system and mobile terminal voice time-indicating method |
| US20160170542A1 (en) * | 2013-08-05 | 2016-06-16 | Lg Electronics Inc. | Mobile terminal and control method therefor |
| CN106094598A (en) * | 2016-08-10 | 2016-11-09 | 广州奥迪威传感应用科技有限公司 | Audio-switch control method, system and audio-switch |
| WO2018006797A1 (en) * | 2016-07-05 | 2018-01-11 | 深圳大学 | System and method for detecting keyboard pressing content by using acoustic signal |
| CN107898432A (en) * | 2017-10-17 | 2018-04-13 | 深圳和而泰智能控制股份有限公司 | Sound of snoring detection method, device, equipment and medium |
| WO2018223489A1 (en) * | 2017-06-09 | 2018-12-13 | 深圳大学 | Intelligent input method and system based on bone conduction vibration signal propagation |
| CN109034046A (en) * | 2018-07-20 | 2018-12-18 | 国网重庆市电力公司电力科学研究院 | Foreign matter automatic identifying method in a kind of electric energy meter based on Acoustic detection |
| CN109032482A (en) * | 2018-07-03 | 2018-12-18 | Oppo广东移动通信有限公司 | Split screen control method, device, storage medium and electronic equipment |
-
2020
- 2020-10-22 CN CN202011137445.6A patent/CN112272019A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102999279A (en) * | 2012-11-29 | 2013-03-27 | 四川长虹电器股份有限公司 | Method for controlling intelligent device through knocks |
| CN103152481A (en) * | 2013-02-27 | 2013-06-12 | 上海斐讯数据通信技术有限公司 | Mobile terminal voice time-indicating system and mobile terminal voice time-indicating method |
| US20160170542A1 (en) * | 2013-08-05 | 2016-06-16 | Lg Electronics Inc. | Mobile terminal and control method therefor |
| WO2018006797A1 (en) * | 2016-07-05 | 2018-01-11 | 深圳大学 | System and method for detecting keyboard pressing content by using acoustic signal |
| CN106094598A (en) * | 2016-08-10 | 2016-11-09 | 广州奥迪威传感应用科技有限公司 | Audio-switch control method, system and audio-switch |
| WO2018223489A1 (en) * | 2017-06-09 | 2018-12-13 | 深圳大学 | Intelligent input method and system based on bone conduction vibration signal propagation |
| CN107898432A (en) * | 2017-10-17 | 2018-04-13 | 深圳和而泰智能控制股份有限公司 | Sound of snoring detection method, device, equipment and medium |
| CN109032482A (en) * | 2018-07-03 | 2018-12-18 | Oppo广东移动通信有限公司 | Split screen control method, device, storage medium and electronic equipment |
| CN109034046A (en) * | 2018-07-20 | 2018-12-18 | 国网重庆市电力公司电力科学研究院 | Foreign matter automatic identifying method in a kind of electric energy meter based on Acoustic detection |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106910500B (en) | Method and device for voice control of device with microphone array | |
| CN107450390B (en) | intelligent household appliance control device, control method and control system | |
| US9487167B2 (en) | Vehicular speech recognition grammar selection based upon captured or proximity information | |
| EP3517849B1 (en) | Household appliance control method, device and system, and intelligent air conditioner | |
| CN114127665B (en) | Multimodal user interface | |
| CN105931640B (en) | Low power detection of activation phrases | |
| CN108711430B (en) | Speech recognition method, intelligent device and storage medium | |
| CN102938820B (en) | Mobile phone proximity waking method and mobile phone proximity waking device | |
| CN109767769B (en) | Voice recognition method and device, storage medium and air conditioner | |
| CN106898348B (en) | Dereverberation control method and device for sound production equipment | |
| CN110892476A (en) | Device with voice command input capability | |
| CN104580699B (en) | Acoustic control intelligent terminal method and device when a kind of standby | |
| CN105206275A (en) | Device control method, apparatus and terminal | |
| CN105700372A (en) | Intelligent device and control method thereof | |
| CN109903758B (en) | Audio processing method and device and terminal equipment | |
| US20150365750A1 (en) | Activating Method and Electronic Device Using the Same | |
| CN110767225A (en) | Voice interaction method, device and system | |
| CN109837688B (en) | Method for automatically identifying human body action and washing machine with same | |
| CN109644218A (en) | The method, apparatus and manufacture in the orientation of display are controlled using biometric sensor | |
| CN108038947B (en) | Intelligent door lock system based on Bluetooth | |
| CN110033773B (en) | Voice recognition method, device, system and equipment for vehicle and vehicle | |
| EP3731507A1 (en) | Surface detection for mobile devices | |
| CN112272019A (en) | Control method and device for sound-control knocking switch, household appliance and storage medium | |
| CN108670150B (en) | Voice control method and device for drawer type dish washing machine and readable storage medium | |
| CN109256145A (en) | Audio-frequency processing method, device, terminal and readable storage medium storing program for executing based on terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |