CN111722715A - Gesture control system and electronic equipment - Google Patents
Gesture control system and electronic equipment Download PDFInfo
- Publication number
- CN111722715A CN111722715A CN202010554372.4A CN202010554372A CN111722715A CN 111722715 A CN111722715 A CN 111722715A CN 202010554372 A CN202010554372 A CN 202010554372A CN 111722715 A CN111722715 A CN 111722715A
- Authority
- CN
- China
- Prior art keywords
- gesture
- ultrasonic
- communication module
- module
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000009471 action Effects 0.000 claims abstract description 89
- 238000012545 processing Methods 0.000 claims abstract description 69
- 238000004891 communication Methods 0.000 claims description 73
- 238000006243 chemical reaction Methods 0.000 claims description 15
- 238000001914 filtration Methods 0.000 claims description 2
- 230000003068 static effect Effects 0.000 claims description 2
- 230000000875 corresponding effect Effects 0.000 description 30
- 238000010586 diagram Methods 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 9
- 230000010354 integration Effects 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 6
- 230000003993 interaction Effects 0.000 description 5
- 238000000034 method Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 238000013519 translation Methods 0.000 description 3
- 239000007787 solid Substances 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
- H04R1/1041—Mechanical or electronic switches, or control elements
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a gesture control system and electronic equipment, wherein the gesture control system comprises: the system comprises an ultrasonic gesture recognition module, a data processing module, a microcontroller and an execution component; the ultrasonic gesture recognition module comprises a plurality of ultrasonic sensors which are arranged in an array and used for detecting gesture operation and forming an electric signal according to the gesture operation; the data processing module is electrically connected with the ultrasonic gesture recognition module and is used for recognizing action instructions corresponding to electric signals formed by the gesture operation; the microcontroller is electrically connected with the data processing module and is used for generating a control instruction according to the action instruction and sending the control instruction to the execution component, so that the execution component executes feedback operation corresponding to the control instruction. The invention provides a gesture control system and electronic equipment, and aims to solve the problem that the recognition success rate of the existing gesture recognition scheme is low.
Description
Technical Field
The invention relates to the technical field of portable listening equipment, in particular to a gesture control system and electronic equipment.
Background
The man-machine interaction modes of most real Wireless Stereo (TWS) earphones on the market at present can be roughly classified into the following three types: the first type adopts the traditional solid key mode to carry out human-computer interaction control on the earphone, and a user can control the earphone by clicking keys and other operations on solid equipment such as a mobile phone and the like, and the scheme has the advantages of low cost, mature and reliable scheme, but the interaction mode is simpler and has low interestingness; and in the second type, a touch control mode is adopted, the touch control panel is arranged on the earphone, and the host sends a command to control the earphone by identifying the operation of fingers on the touch control panel and transmitting the operation to the host of the earphone. Such schemes are limited by the touch area, and the instruction control operation is relatively limited; and thirdly, recognizing the related gesture command by the earphone by combining the earphone with the related gesture recognition technology in a gesture recognition mode, and transmitting the related gesture command to the host computer to enable the host computer to send the related command. The scheme increases the interest of interaction and greatly enriches the gestures of operation.
However, in the existing gesture recognition scheme, an optical infrared technology is generally adopted to recognize and collect gestures of a human body, and then collected gesture instructions are transmitted to a host through a corresponding protocol, so that the host sends an operation command to an earphone. However, the gesture recognition process based on the optical infrared technology is easily affected by the surrounding environment and the light intensity, so that the recognition success rate is reduced.
Disclosure of Invention
The embodiment of the invention provides a gesture control system and electronic equipment, and aims to solve the problem that the existing gesture recognition scheme is low in recognition success rate.
In a first aspect, an embodiment of the present invention provides a gesture control system, including: the system comprises an ultrasonic gesture recognition module, a data processing module, a microcontroller and an execution component;
the ultrasonic gesture recognition module comprises a plurality of ultrasonic sensors which are arranged in an array and used for detecting gesture operation and forming an electric signal according to the gesture operation; the data processing module is electrically connected with the ultrasonic gesture recognition module and is used for recognizing action instructions corresponding to electric signals formed by the gesture operation;
the microcontroller is electrically connected with the data processing module and is used for generating a control instruction according to the action instruction and sending the control instruction to the execution component, so that the execution component executes feedback operation corresponding to the control instruction.
In a second aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes the gesture control system provided in any embodiment of the present invention.
The gesture control system comprises an ultrasonic gesture recognition module, a data processing module, a microcontroller and an execution component, wherein the ultrasonic sensors arranged in an array are used for detecting gesture operations of a user and converting the detected gesture operations into electric signals, the data processing module can identify action instructions corresponding to the gesture operations, the microcontroller can generate control instructions according to the action instructions and is connected with the execution component, and the execution component can be controlled by the control instructions to execute feedback operations corresponding to the control instructions, so that the non-contact control of electronic equipment through the gesture operations is achieved, the control path of the electronic equipment is expanded, and the control interestingness is enhanced. And compared with the optical infrared recognition technology, the ultrasonic recognition mode of the ultrasonic sensor is not easily influenced by the surrounding environment and light, and the recognition success rate of gesture operation is high. In addition, the gesture control system based on the ultrasonic recognition mode does not depend on a high-bandwidth receiver, reduces power consumption and improves the integration level of the gesture control system.
Drawings
Fig. 1 is a schematic structural diagram of a gesture control system according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of an ultrasonic gesture recognition module according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a data processing module according to an embodiment of the present invention;
FIG. 4 is an integrated schematic diagram of a gesture control system according to an embodiment of the present invention;
FIG. 5 is an integrated schematic diagram of another gesture control system provided by an embodiment of the present invention;
FIG. 6 is an integrated schematic diagram of another gesture control system provided by an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of another electronic device according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
The embodiment of the invention provides a gesture control system, which comprises: the system comprises an ultrasonic gesture recognition module, a data processing module, a microcontroller and an execution component;
the ultrasonic gesture recognition module comprises a plurality of ultrasonic sensors which are arranged in an array and used for detecting gesture operation and forming an electric signal according to the gesture operation; the data processing module is electrically connected with the ultrasonic gesture recognition module and is used for recognizing action instructions corresponding to the electric signals formed by the gesture operation;
the microcontroller is electrically connected with the data processing module and is used for generating a control instruction according to the action instruction and sending the control instruction to the execution component, so that the execution component executes feedback operation corresponding to the control instruction.
In the embodiment of the invention, the gesture control system comprises an ultrasonic gesture recognition module, a data processing module, a microcontroller and an execution component, wherein the ultrasonic sensors arranged in an array are used for detecting gesture operations of a user and converting the detected gesture operations into electric signals, the data processing module can identify action instructions corresponding to the gesture operations, the microcontroller can generate control instructions according to the action instructions and is connected with the execution component, and the execution component can be controlled by the control instructions to execute feedback operations corresponding to the control instructions, so that the non-contact control of electronic equipment through the gesture operations is realized, the control path of the electronic equipment is expanded, and the control interestingness is enhanced. And compared with the optical infrared recognition technology, the ultrasonic recognition mode of the ultrasonic sensor is not easily influenced by the surrounding environment and light, and the recognition success rate of gesture operation is high. In addition, the gesture control system based on the ultrasonic recognition mode does not depend on a high-bandwidth receiver, reduces power consumption and improves the integration level of the gesture control system.
The above is the core idea of the present invention, and the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without any creative work belong to the protection scope of the present invention.
Fig. 1 is a schematic structural diagram of a gesture control system according to an embodiment of the present invention, as shown in fig. 1, the gesture control system includes an ultrasonic gesture recognition module 11, a data processing module 12, a microcontroller 13, and an execution unit 14, where the ultrasonic gesture recognition module 11 includes ultrasonic sensors 111 arranged in an array, and is capable of detecting a gesture operation of a user through properties such as reflection of an ultrasonic signal, and converting the ultrasonic signal returned by the gesture operation of the user into an electrical signal. The data processing module 12 may receive the electric signal converted from the ultrasonic signal sent by the ultrasonic gesture recognition module 11, and may recognize the motion instruction corresponding to the gesture operation of the user according to the electric signal. In this embodiment, the gesture operations of the user correspond to the action instructions one to one, the corresponding relationship between the gesture operations and the action instructions can be set by the user, and the corresponding relationship between the gesture operations and the action instructions can also be set by the system. The microcontroller 13 is configured to receive the action instruction output by the data processing module 12, and the microcontroller 13 can generate a corresponding control instruction according to the action instruction, so that the execution component 14 can execute a feedback operation corresponding to the action instruction according to the control instruction. In this embodiment, the gesture recognition technology based on ultrasonic signals is adopted, and compared with the optical infrared recognition technology, the gesture recognition technology is less affected by the intensity of ambient light, and the gesture recognition success rate is higher. Moreover, for the optical infrared recognition technology, a high-bandwidth receiver is required, so that the power consumption of the whole system is increased, the volume of the system is large, the system is not favorable for the integrated setting of the system, and the gesture control system based on the ultrasonic signals does not depend on the receiver with the high bandwidth, so that the power consumption is reduced, and the integration level of the gesture control system is improved. The ultrasonic gesture recognition module 11 can integrate a plurality of ultrasonic sensors 111 arranged in an array, so that two-dimensional or more than two-dimensional gesture operation can be detected, and the gesture recognition accuracy is improved.
It should be noted that the gesture control system can be applied to electronic devices such as mobile phones, computers, ipads, wearable devices, wireless headsets, and audio devices to realize contactless adjustment and control of the electronic devices, for example, the gesture operation is used to realize action instructions such as opening, closing, sound and video playing, audio playing and the like of the electronic devices, so that the interest of interaction between users and the electronic devices is enhanced, the operation modes of the electronic devices can be widened, and the integration of more action instructions on the electronic devices is facilitated.
In a specific example of the embodiment, the gesture control system may be applied to a Wireless headset, for example, a True Wireless Stereo (TWS) headset, and the action instruction may include at least one of the following: starting the device, switching songs, turning up the volume, turning down the volume and turning off the device. When the gesture control system is applied to the wireless headset, the action instruction can be realized through the gesture operation. For the wireless headset, the action instructions may include the above action instructions for starting the headset device, turning off the headset device, turning up the volume, turning down the volume, and switching the tracks, and in addition, the action instructions may also include action instructions for pausing the playing, deleting the tracks, and the like, and the embodiment does not limit the action instructions based on the wireless headset.
In addition, when the gesture control system is applied to other electronic devices, the action command may further include other operations. For example, when the user browses a small video, the user may send an action instruction to the mobile phone through gesture operation to implement a contactless operation.
Optionally, the gesture operation includes at least one of the following: lifting the hand to be static, horizontally moving the hand and drawing a line. In this embodiment, gesture operations corresponding to each action instruction are set, for example, when the electronic device needs to be opened, a user may lift a hand and stand still on one side of the electronic device, so that the ultrasonic gesture recognition module 11 on the electronic device detects the gesture operations through ultrasonic signals, and the ultrasonic gesture recognition module 11 detects the gesture operations on one side of the electronic device, so that the data processing module 12 recognizes the gesture operations, obtains the action instruction corresponding to the gesture operations, and is convenient to execute the feedback operation corresponding to the action instruction. In addition, the user can perform gesture operation of raising the hand and translating and gesture operation of raising the hand and drawing a line on one side of the electronic equipment. Specifically, the gesture operation of drawing a line by raising a hand may include operations of drawing a circle by raising a hand, drawing a square symbol by raising a hand, drawing an L by raising a hand, drawing a x by raising a hand, and the like, and the specific shape of the line is not limited in this embodiment. If the electronic device is a wireless headset, the action instruction of the song can be switched through the hand-raising translation operation, for example, the hand-raising translation left corresponds to the action instruction of the previous song, and the hand-raising translation right corresponds to the action instruction of the next song. The action instructions of "pause" and "play" of the wireless headset can also be realized through the gesture operation of drawing a line by raising a hand, for example, drawing a square on one side of the electronic equipment by raising a hand to realize the action instruction of "play" of the wireless headset, and drawing a x on one side of the electronic equipment by raising a hand to realize the action instruction of "pause" of the wireless headset.
Optionally, as shown in fig. 2, fig. 2 is a schematic structural diagram of an ultrasonic gesture recognition module according to an embodiment of the present invention, where the ultrasonic gesture recognition module may include: an ultrasonic signal transmitting unit 112, an ultrasonic signal receiving unit 113, an analog data processing unit 114, and an analog-to-digital conversion unit 115; the ultrasonic signal transmitting unit 112 includes a plurality of ultrasonic sensors 111 arranged in an array for transmitting ultrasonic signals; the ultrasonic signal receiving unit 113 includes a plurality of ultrasonic sensors 111 arranged in an array, and is configured to receive ultrasonic signals reflected by a gesture operation of a human body and convert the ultrasonic signals into electrical signals; the analog data processing unit 114 is used for amplifying and filtering the electric signal; the analog-to-digital conversion unit 115 is used to convert the electrical signal from an analog signal to a digital signal.
The ultrasonic signal transmitting unit 112 comprises a plurality of ultrasonic sensors 111 arranged in an array and can transmit large-voltage ultrasonic signals, the ultrasonic signal receiving unit 113 also comprises a plurality of ultrasonic sensors 111 arranged in an array and can detect the ultrasonic signals reflected by the surface of a human body and further detect gesture operation of the human body, and the ultrasonic sensors 111 arranged in an array can detect specific gesture operation of the human body through a three-dimensional gesture recognition algorithm and can convert the ultrasonic signals into electric signals. Alternatively, the ultrasonic sensor 111 may be a piezoelectric ultrasonic transducer. The piezoelectric conversion efficiency of the piezoelectric ultrasonic transducer determines the ultrasonic wave receiving performance of the ultrasonic gesture recognition module, the piezoelectric ultrasonic transducer array has the function of transmitting or receiving ultrasonic wave signals, and optionally, the ultrasonic sensor 111 of the ultrasonic signal receiving unit 113 can be multiplexed as the ultrasonic sensor 111 of the ultrasonic signal transmitting unit 112, so that the setting number of the ultrasonic sensors 111 is effectively reduced, the integration size of the ultrasonic gesture recognition module is reduced, and the integration level of the gesture control system is improved. Because the ultrasonic signals are lost when being transmitted in the air, and the loss is more serious as the frequency of the ultrasonic signals is higher, the ultrasonic signals with lower frequency need to be selected for detecting the gesture operation, and a corresponding high-voltage driving circuit needs to be arranged for driving the ultrasonic signal transmitting unit 112, so that the measurable distance and the range of a gesture control system are increased, and the situation that the gesture operation cannot be detected when a human body is far away from the electronic equipment is avoided.
The analog data processing unit 114 can amplify and filter the electrical signal for identifying the gesture operation, so as to amplify and denoise the electrical signal, so that the ultrasonic gesture recognition module obtains accurate information related to the gesture operation, and the accuracy of gesture operation recognition is enhanced. Specifically, the analog data processing unit 114 includes an analog signal filter and an analog signal amplifier, wherein the analog signal filter can effectively increase the measurement range and the external noise resistance of the gesture control system. The analog signal amplifier can effectively reduce noise and realize high speed and reasonable amplification factor. Optionally, in this embodiment, the analog signal amplifier may be a band-pass filter, which can effectively filter high-frequency and low-frequency noise, so that the subsequent module can process the electrical signal more accurately.
The analog-to-digital conversion unit 115 is electrically connected to the analog data processing unit 114, and can convert an electrical signal from an analog signal to a digital signal. Optionally, the analog-to-digital conversion unit 115 includes an analog-to-digital conversion circuit, which is an analog-to-digital conversion circuit with multiple conversion bits and has the advantages of high conversion rate and low power consumption.
As shown in fig. 3, fig. 3 is a schematic structural diagram of a data processing module according to an embodiment of the present invention. Optionally, the data processing module may include: a gesture recognition signal unit 121, a motion instruction generation unit 122, and a motion instruction library 123; the gesture recognition signal unit 121 is configured to acquire and store a digital signal corresponding to the gesture operation output by the analog-to-digital conversion unit; the action instruction generating unit 122 is configured to match the digital signal in the action instruction library 123 to obtain an action instruction corresponding to the digital signal; the action instruction library 123 stores an action instruction table, and the action instruction table comprises digital signals and action instructions which are correspondingly arranged one by one; the action instruction generating unit 122 is further configured to generate an instruction code according to the action instruction, and send the instruction code to the microcontroller, so that the microcontroller generates a control instruction according to the instruction code.
The data processing module is mainly used for processing the digital signals converted by the analog-to-digital conversion unit and identifying the action instruction corresponding to the gesture operation according to the digital signals for identifying the gesture operation. Before that, the action instruction library 23 needs to be established according to the one-to-one correspondence relationship between the gesture operation and the action instruction, where the action instruction library 23 includes an action instruction table, and the action instruction table records the one-to-one correspondence relationship between the digital signal for identifying the gesture operation and the action instruction, that is, an index relationship is established between the digital signal and the corresponding action instruction, so that the data processing module can obtain the matched action instruction according to the digital signal. For example, in fig. 3, the digital signal "x 1" matches the action command "previous song" and the digital signal "x 2" matches the action command "next song", so that the action command corresponding to the digital signal can be quickly located according to the index relationship, and the gesture recognition efficiency of the gesture control system is improved. The gesture recognition signal unit 21 of the data processing module can receive and store the digital signal converted by the gesture operation output by the analog-to-digital conversion unit, and the action instruction generation unit 22 can obtain the digital signal and obtain the action instruction matched with the digital signal according to the index relationship in the action instruction table. On this basis, the action instruction generating unit 22 is further configured to generate an instruction code according to the action instruction, and the microcontroller can generate a control instruction corresponding to the gesture operation according to the instruction code, so that the executing component performs a feedback operation according to the operation instruction, where the feedback operation corresponds to the action instruction one by one, and is an operation that the electronic device implements the action instruction. Illustratively, if the action command is "last song", the corresponding feedback operation causes the wireless headset to play the last song.
When the gesture control system is applied to a wireless headset, the electronic device further includes a host device (e.g., a mobile phone, an ipad, etc.) that is matched with the wireless headset, and a part of modules of the gesture control system is integrated in a main device that is wirelessly connected with the wireless headset. The integration of a number of different gesture control systems on the wireless headset and the main body will be described below:
as shown in fig. 4, fig. 4 is an integrated schematic diagram of a gesture control system according to an embodiment of the present invention, and optionally, the gesture control system may further include: a first communication module 15 and a second communication module 16; the ultrasonic gesture recognition module 11, the data processing module 12 and the first communication module 15 are arranged on the host device 21; the microcontroller 13, the execution part 14 and the second communication module 16 are arranged on a wireless earphone 22 which is wirelessly connected with the host device 21; the first communication module 15 is connected with the data processing module 12 and is used for transmitting the action instruction to the second communication module 16 of the wireless headset 22; the second communication module 16 is connected to the microcontroller 13 and is configured to send an action command to the microcontroller 13.
In this example, the ultrasonic gesture recognition module 11 and the data processing module 12 are integrated in the host device 21, because the data processing module 12 processes and stores a corresponding relationship of action instructions of a large number of digital signals, a memory needs to be arranged, the occupied physical space is enlarged, and it is difficult to integrate the data processing module 12 on the wireless headset 22, the data processing module 12 can be arranged on the host device 21, the action instructions output by the data processing module 12 are transmitted to the second communication module 16 of the wireless headset 22 through the first communication module 15, so that the microcontroller 13 on the wireless headset 22 controls the execution component 14 to perform feedback operation, and the wireless headset 22 only integrates the microcontroller 13 and the execution component 14, and the integration size is small, thereby facilitating application of the gesture control system to the wireless headset 22. It should be noted that the ultrasonic gesture recognition module 11 is integrated in the host device 21 in this example, and when the user controls the wireless headset through a gesture operation, the gesture operation needs to be performed at a position close to the host device 21.
As shown in fig. 5, fig. 5 is an integrated schematic view of another gesture control system provided in the embodiment of the present invention, and optionally, the gesture control system may further include: a first communication module 15 and a second communication module 16; the data processing module 12 and the first communication module 15 are arranged on the host device 21, and the ultrasonic gesture recognition module 11, the microcontroller 13, the execution component 14 and the second communication module 16 are arranged on a wireless earphone 22 wirelessly connected with the host device 21; the second communication module 16 is connected with the ultrasonic gesture recognition module 11 and is used for transmitting the electric signal to the first communication module 15 on the host device 21; the first communication module 15 is connected with the data processing module 12 and is used for sending the electric signal to the data processing module 12; the first communication module 15 is further configured to send the action instruction output by the data processing module 12 to the second communication module 16; the second communication module 16 is connected to the microcontroller 13 and is configured to send an action command to the microcontroller 13.
In this example, the ultrasonic gesture recognition module 11, the microcontroller 13 and the execution component 14 are integrated on the wireless headset 22, the data processing module 12 is disposed on the host device 21, and the second communication module 16 can transmit the electric signal corresponding to the gesture operation output by the ultrasonic gesture recognition module 11 on the wireless headset 22 to the first communication module 15 on the host device 21, so that the first communication module 15 transmits the electric signal to the data processing module 12, and meanwhile, the first communication module 15 can transmit the action command output by the data processing module 12 to the microcontroller 13 through the second communication module. It should be noted that the ultrasonic gesture recognition module 11 is integrated on the wireless headset 22 in this example, and when the user controls the wireless headset through a gesture operation, the gesture operation needs to be performed at a position close to the wireless headset 22.
As shown in fig. 6, fig. 6 is an integrated schematic view of another gesture control system provided in the embodiment of the present invention, and optionally, the gesture control system may further include: a first communication module 15 and a second communication module 16; the data processing module 12, the microcontroller 13 and the first communication module 15 are arranged on the host device 21, and the ultrasonic gesture recognition module 11, the execution component 14 and the second communication module 16 are arranged on a wireless earphone 22 wirelessly connected with the host device 21; the second communication module 16 is connected with the ultrasonic gesture recognition module 11 and is used for transmitting the electric signal to the first communication module 15 on the host device 21; the first communication module 15 is connected with the data processing module 12 and is used for sending the electric signal to the data processing module 12; the first communication module 15 is further connected with the microcontroller 13, and is configured to send a control instruction output by the microcontroller 13 to the second communication module 16; the second communication module 16 is connected to the execution unit 14, and is configured to send the manipulation instruction to the execution unit 14.
In this example, the data processing module 12 and the microcontroller 13 are integrated on the host device 21, the ultrasonic gesture recognition module 11 and the execution component 14 are integrated on the wireless headset 22, the second communication module 16 sends an electric signal corresponding to the gesture operation, output by the ultrasonic gesture recognition module 11 on the wireless headset 22, to the first communication module 15 of the host device 21, so that the first communication module 15 sends the electric signal to the data processing module 12, the data processing module 12 sends a motion instruction corresponding to the gesture operation to the microcontroller 13, so that the microcontroller 13 sends a manipulation instruction to the first communication module 15, so that the first communication module 15 sends the manipulation instruction to the execution component 14 through the second communication module 16. It should be noted that the ultrasonic gesture recognition module 11 is integrated on the wireless headset 22 in this example, and when the user controls the wireless headset through a gesture operation, the gesture operation needs to be performed at a position close to the wireless headset 22.
Optionally, the first communication module 15 and the second communication module 16 may include at least one of a bluetooth module, a 5G module, a 4G module, or a WIFI module. The first communication module 15 and the second communication module 16 may be connected by other wireless methods, which is not limited in this embodiment.
The embodiment of the invention realizes the gesture operation identification process through the ultrasonic signal, and the ultrasonic signal has lower sensitivity to the ambient light, lower power consumption and higher integration level. In addition, the gesture control system that this embodiment provided is strong in operability, and portability is strong, can integrate in multiple electronic equipment, and this embodiment only indicates with wireless earphone, to electronic equipment such as wearable equipment, all can integrate above-mentioned gesture control system to electronic equipment's use is convenient for.
The embodiment of the invention also provides the electronic equipment. Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 7, an electronic device 2 according to an embodiment of the present invention includes a gesture control system 1 according to any embodiment of the present invention. The electronic device may be a mobile phone, a computer, a television, an intelligent wearable device, and the like, which is not particularly limited in this embodiment. The electronic equipment comprises all technical characteristics of the gesture control system provided by any embodiment of the invention, and has the beneficial effect of the gesture control system.
As shown in fig. 8, fig. 8 is a schematic structural diagram of another electronic device provided in an embodiment of the present invention, and optionally, the electronic device may further include: a main body device 21 and a wireless headset 22 wirelessly connected to the main body device 21; the wireless headset 22 is integrated with an ultrasonic gesture recognition module, a microcontroller and an execution component of a gesture control system; the main body device 21 is integrated with a data processing module of the gesture control system. In this embodiment, the ultrasonic gesture recognition module, the microcontroller and the execution component are integrated in the wireless headset 22, and the data processing module is disposed in the main device 21, so that the problem that the data processing module is large and is not easy to integrate in the wireless headset 22 is effectively solved. In this embodiment, when the user performs a gesture operation near the wireless headset 22, the ultrasonic gesture recognition module in the wireless headset 22 can accurately recognize the gesture operation through the ultrasonic signal, so as to control the wireless headset 22 to perform a feedback operation corresponding to the gesture operation.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (12)
1. A gesture control system, comprising: the system comprises an ultrasonic gesture recognition module, a data processing module, a microcontroller and an execution component;
the ultrasonic gesture recognition module comprises a plurality of ultrasonic sensors which are arranged in an array and used for detecting gesture operation and forming an electric signal according to the gesture operation; the data processing module is electrically connected with the ultrasonic gesture recognition module and is used for recognizing action instructions corresponding to electric signals formed by the gesture operation;
the microcontroller is electrically connected with the data processing module and is used for generating a control instruction according to the action instruction and sending the control instruction to the execution component, so that the execution component executes feedback operation corresponding to the control instruction.
2. The gesture control system of claim 1, wherein the ultrasonic gesture recognition module comprises: the ultrasonic signal processing device comprises an ultrasonic signal transmitting unit, an ultrasonic signal receiving unit, an analog data processing unit and an analog-to-digital conversion unit;
the ultrasonic signal transmitting unit comprises a plurality of ultrasonic sensors which are arranged in an array and used for transmitting ultrasonic signals; the ultrasonic signal receiving unit comprises a plurality of ultrasonic sensors which are arranged in an array and used for receiving ultrasonic signals reflected by the gesture operation of a human body and converting the ultrasonic signals into electric signals; the analog data processing unit is used for amplifying and filtering the electric signal; the analog-to-digital conversion unit is used for converting the electric signal from an analog signal to a digital signal.
3. The gesture control system according to claim 2, characterized in that the ultrasonic sensors of the ultrasonic signal receiving unit are multiplexed as the ultrasonic sensors of the ultrasonic signal transmitting unit.
4. The gesture control system according to claim 3, wherein said ultrasonic sensor is a piezoelectric ultrasonic transducer.
5. The gesture control system according to claim 2, wherein the data processing module comprises: the gesture recognition device comprises a gesture recognition signal unit, an action instruction generating unit and an action instruction library;
the gesture recognition signal unit is used for acquiring and storing the digital signal corresponding to the gesture operation output by the analog-to-digital conversion unit;
the action instruction generating unit is used for matching the digital signals in an action instruction library to obtain action instructions corresponding to the digital signals; an action instruction table is stored in the action instruction library, and the action instruction table comprises the digital signals and the action instructions which are arranged in a one-to-one correspondence manner;
the action instruction generating unit is also used for generating an instruction code according to the action instruction and sending the instruction code to the microcontroller, so that the microcontroller generates a control instruction according to the instruction code.
6. The gesture control system according to claim 1, further comprising: a first communication module and a second communication module;
the ultrasonic gesture recognition module, the data processing module and the first communication module are arranged on host equipment; the microcontroller, the execution component and the second communication module are arranged on a wireless earphone which is wirelessly connected with the host equipment;
the first communication module is connected with the data processing module and used for transmitting the action instruction to a second communication module of the wireless headset; and the second communication module is connected with the microcontroller and is used for sending the action instruction to the microcontroller.
7. The gesture control system according to claim 1, further comprising: a first communication module and a second communication module;
the data processing module and the first communication module are arranged on host equipment, and the ultrasonic gesture recognition module, the microcontroller, the execution component and the second communication module are arranged on a wireless earphone which is in wireless connection with the host equipment;
the second communication module is connected with the ultrasonic gesture recognition module and used for transmitting the electric signal to the first communication module on the host equipment; the first communication module is connected with the data processing module and used for sending the electric signal to the data processing module;
the first communication module is further used for sending the action instruction output by the data processing module to the second communication module; the second communication module is connected with the microcontroller and used for sending the action instruction to the microcontroller.
8. The gesture control system according to claim 1, further comprising: a first communication module and a second communication module;
the data processing module, the microcontroller and the first communication module are arranged on host equipment, and the ultrasonic gesture recognition module, the execution component and the second communication module are arranged on a wireless earphone which is wirelessly connected with the host equipment;
the second communication module is connected with the ultrasonic gesture recognition module and used for transmitting the electric signal to the first communication module on the host equipment; the first communication module is connected with the data processing module and used for sending the electric signal to the data processing module;
the first communication module is also connected with the microcontroller and is used for sending the control instruction output by the microcontroller to the second communication module; the second communication module is connected with the execution component and used for sending the control instruction to the execution component.
9. The gesture control system according to any one of claims 6-8, wherein the first communication module and the second communication module comprise at least one of a bluetooth module, a 5G module, a 4G module, or a WIFI module.
10. The gesture control system according to any of claims 6-8, characterized in that the action instructions comprise at least one of the following: starting the equipment, switching songs, turning up the volume, turning down the volume and closing the equipment;
the gesture operation includes at least one of: lifting the hand to be static, horizontally moving the hand and drawing a line.
11. An electronic device characterized by comprising a gesture control system according to any one of claims 1-10.
12. The electronic device of claim 11, further comprising: the wireless earphone comprises a main body device and a wireless earphone which is in wireless connection with the main body device;
the wireless earphone is integrated with an ultrasonic gesture recognition module, a microcontroller and an execution component of the gesture control system; the main body equipment is integrated with a data processing module of the gesture control system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010554372.4A CN111722715A (en) | 2020-06-17 | 2020-06-17 | Gesture control system and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010554372.4A CN111722715A (en) | 2020-06-17 | 2020-06-17 | Gesture control system and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111722715A true CN111722715A (en) | 2020-09-29 |
Family
ID=72567147
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010554372.4A Pending CN111722715A (en) | 2020-06-17 | 2020-06-17 | Gesture control system and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111722715A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112987925A (en) * | 2021-03-04 | 2021-06-18 | 歌尔科技有限公司 | Earphone and control method and device thereof |
| WO2023279600A1 (en) * | 2021-07-08 | 2023-01-12 | 歌尔股份有限公司 | Sound effect adjusting method and apparatus for earphones, and readable storage medium |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104410938A (en) * | 2014-12-23 | 2015-03-11 | 上海斐讯数据通信技术有限公司 | Intelligent headset and control method thereof |
| CN104898844A (en) * | 2015-01-23 | 2015-09-09 | 瑞声光电科技(常州)有限公司 | Gesture recognition and control device based on ultrasonic positioning and gesture recognition and control method based on ultrasonic positioning |
| CN105334958A (en) * | 2015-09-11 | 2016-02-17 | 南京西西弗信息科技有限公司 | Gesture recognition system and realization method |
| CN106155271A (en) * | 2015-03-25 | 2016-11-23 | 联想(北京)有限公司 | Earphone, electronic apparatus system, control instruction determine method and data processing unit |
| CN106446801A (en) * | 2016-09-06 | 2017-02-22 | 清华大学 | Micro-gesture identification method and system based on ultrasonic active detection |
| CN107360304A (en) * | 2016-05-10 | 2017-11-17 | 合盈光电科技股份有限公司 | Gesture control modular system |
| CN108344995A (en) * | 2018-01-25 | 2018-07-31 | 宁波隔空智能科技有限公司 | A kind of gesture identifying device and gesture identification method based on microwave radar technology |
| CN108873715A (en) * | 2018-07-04 | 2018-11-23 | 深圳众厉电力科技有限公司 | Intelligent home control system based on gesture identification |
| CN208190864U (en) * | 2017-10-27 | 2018-12-04 | 北京金锐德路科技有限公司 | Neck wears formula interactive voice earphone |
| CN109240551A (en) * | 2018-08-17 | 2019-01-18 | Oppo（重庆）智能科技有限公司 | Use the method and Related product of gesture control electronic device |
| CN109298791A (en) * | 2018-10-24 | 2019-02-01 | Oppo广东移动通信有限公司 | Terminal control method, device, storage medium and mobile terminal |
| US20190041994A1 (en) * | 2017-08-04 | 2019-02-07 | Center For Integrated Smart Sensors Foundation | Contactless gesture recognition system and method thereof |
| CN109857245A (en) * | 2017-11-30 | 2019-06-07 | 腾讯科技（深圳）有限公司 | A kind of gesture identification method and terminal |
| CN111108408A (en) * | 2017-06-27 | 2020-05-05 | 苹果公司 | Gesture recognition radar system and method |
-
2020
- 2020-06-17 CN CN202010554372.4A patent/CN111722715A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104410938A (en) * | 2014-12-23 | 2015-03-11 | 上海斐讯数据通信技术有限公司 | Intelligent headset and control method thereof |
| CN104898844A (en) * | 2015-01-23 | 2015-09-09 | 瑞声光电科技(常州)有限公司 | Gesture recognition and control device based on ultrasonic positioning and gesture recognition and control method based on ultrasonic positioning |
| CN106155271A (en) * | 2015-03-25 | 2016-11-23 | 联想(北京)有限公司 | Earphone, electronic apparatus system, control instruction determine method and data processing unit |
| CN105334958A (en) * | 2015-09-11 | 2016-02-17 | 南京西西弗信息科技有限公司 | Gesture recognition system and realization method |
| CN107360304A (en) * | 2016-05-10 | 2017-11-17 | 合盈光电科技股份有限公司 | Gesture control modular system |
| CN106446801A (en) * | 2016-09-06 | 2017-02-22 | 清华大学 | Micro-gesture identification method and system based on ultrasonic active detection |
| CN111108408A (en) * | 2017-06-27 | 2020-05-05 | 苹果公司 | Gesture recognition radar system and method |
| US20190041994A1 (en) * | 2017-08-04 | 2019-02-07 | Center For Integrated Smart Sensors Foundation | Contactless gesture recognition system and method thereof |
| CN208190864U (en) * | 2017-10-27 | 2018-12-04 | 北京金锐德路科技有限公司 | Neck wears formula interactive voice earphone |
| CN109857245A (en) * | 2017-11-30 | 2019-06-07 | 腾讯科技（深圳）有限公司 | A kind of gesture identification method and terminal |
| CN108344995A (en) * | 2018-01-25 | 2018-07-31 | 宁波隔空智能科技有限公司 | A kind of gesture identifying device and gesture identification method based on microwave radar technology |
| CN108873715A (en) * | 2018-07-04 | 2018-11-23 | 深圳众厉电力科技有限公司 | Intelligent home control system based on gesture identification |
| CN109240551A (en) * | 2018-08-17 | 2019-01-18 | Oppo（重庆）智能科技有限公司 | Use the method and Related product of gesture control electronic device |
| CN109298791A (en) * | 2018-10-24 | 2019-02-01 | Oppo广东移动通信有限公司 | Terminal control method, device, storage medium and mobile terminal |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112987925A (en) * | 2021-03-04 | 2021-06-18 | 歌尔科技有限公司 | Earphone and control method and device thereof |
| CN112987925B (en) * | 2021-03-04 | 2022-11-25 | 歌尔科技有限公司 | Earphone and control method and device thereof |
| WO2023279600A1 (en) * | 2021-07-08 | 2023-01-12 | 歌尔股份有限公司 | Sound effect adjusting method and apparatus for earphones, and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI679585B (en) | Method for displaying fingerprint identification area and mobile terminal | |
| CN108519871B (en) | Audio signal processing method and related product | |
| EP3588341B1 (en) | Unlocking control method and related product | |
| KR101969252B1 (en) | Method, apparatus and system of controlling intelligent device based on earphone | |
| CN105302373A (en) | Method and system for achieving operation of mobile terminal according to touch signals and mobile terminal | |
| CN102789218A (en) | Zigbee smart home system based on multiple controllers | |
| WO2003046706A1 (en) | Detecting, classifying, and interpreting input events | |
| KR20140114913A (en) | Apparatus and Method for operating sensors in user device | |
| TW201839650A (en) | Unlocking control method AND mobile terminal | |
| US20200301650A1 (en) | Audio playback control method of mobile terminal and wireless earphone | |
| CN109901698B (en) | Intelligent interaction method, wearable device, terminal and system | |
| CN111722715A (en) | Gesture control system and electronic equipment | |
| CN201435143Y (en) | Remote control device | |
| CN110597147A (en) | Device integrating far-field pickup and charging | |
| CN109246525B (en) | Gesture-based earphone control method and device and headset | |
| JP2023538685A (en) | Electronic equipment assembly, its control method, and electronic equipment control device | |
| CN112098929B (en) | Method, device and system for determining relative angle between intelligent devices and intelligent device | |
| CN110764650A (en) | Key trigger detection method and electronic equipment | |
| CN112256135B (en) | Equipment control method and device, equipment and storage medium | |
| CN207354555U (en) | A kind of wireless headset | |
| CN109121123A (en) | Information processing method and related product | |
| CN113709617A (en) | Wireless earphone control method and device, wireless earphone and storage medium | |
| CN109215649B (en) | Remote control device | |
| CN110297537A (en) | Multimedia file producting method and mobile terminal | |
| CN210274488U (en) | Intelligent sound box and intelligent equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |