CN106527685A - Control method and device for terminal application - Google Patents
Control method and device for terminal application Download PDFInfo
- Publication number
- CN106527685A CN106527685A CN201610871724.2A CN201610871724A CN106527685A CN 106527685 A CN106527685 A CN 106527685A CN 201610871724 A CN201610871724 A CN 201610871724A CN 106527685 A CN106527685 A CN 106527685A
- Authority
- CN
- China
- Prior art keywords
- sensor array
- gesture information
- user
- contact gesture
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
The embodiment of the invention discloses a control method and device for a terminal application. The method comprises the following steps: acquiring user non-touch gesture information through a first sensor array and a second sensor array which are arranged in parallel; recognizing the type of the acquired user non-touch gesture information through preset non-touch gesture information of a user; determining a control command corresponding to the type of the user non-touch gesture information; and controlling the terminal application according to the control command. Through adoption of the control method and device for the terminal application, the user non-touch gesture information is acquired by capacitive sensor recognition panels which are arranged in parallel, so that the terminal application can be controlled rapidly and accurately; a single row and double row multiplexing effect is achieved; the terminal user does not need to perform any operation on a terminal screen; and good user experience is achieved.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of control method of terminal applies and device.
Background technology
With the continuous development of science and technology, people can process complicated and diversified task on intelligent terminal, for example, read electricity
The philosophical works, multimedia picture browsing, music and video playback, web page browsing etc..This is accomplished by between terminal use and intelligent terminal
Frequently information exchange is carried out, including picture switching, is reduced/enlarged, music and video pause, broadcasting, volume is adjusted, net
The basic operations such as the page dragging of page browsing.
Existing most of intelligent terminal, is generally input into using touch gesture identification, i.e., by touch screen induction hand
Refer to or palm single-point on the touchscreen or Multi-contact and action, and be converted into corresponding operational order.Touch hand
Gesture is known relatively more with species otherwise.A kind of is the Gesture Recognition of view-based access control model, and the technology development is relatively more early also to compare
Maturation, but it is stricter to equipment and environmental requirement, and the limitation for using is also just than larger.Another kind is sensor-based identification
Technology, the main gesture sensor for aiding in detection by RGB infrared lights such as on the market, but this technology of identification is existed
Gesture identification function is more single, affected than the relatively low defect of larger, accuracy rate by ambient light.
Compared to traditional touch gesture operation, non-contact gesture operation, especially by every empty hand or on
Main drive makees the experience more remarkable fluency being controlled to mobile intelligent terminal, operates on screen in user's inconvenience hand
Great convenience can be provided the user under scene.
The content of the invention
Present invention is primarily targeted at proposing a kind of control method of terminal applies and device, it is intended to solve contactless
The problem of gesture triggering terminal application.
For achieving the above object, embodiment of the present invention first aspect provides a kind of control method of terminal applies, the side
Method includes step：
User's non-contact gesture information is obtained by the first sensor array and second sensor array that are arranged side by side；
By the non-contact gesture information of user preset, user's non-contact gesture info class of the acquisition is identified
Not；
It is determined that the control instruction corresponding with user's non-contact gesture information category；
According to the control instruction, terminal applies are controlled with operation.
With reference to the embodiment of the present invention in a first aspect, in the first implementation of the first aspect of the embodiment of the present invention,
The first sensor array includes that one or more sensors recognize panel；The second sensor array includes one or many
Individual sensor recognizes panel.
With reference to the embodiment of the present invention in a first aspect, in second implementation of the first aspect of the embodiment of the present invention,
User's non-contact gesture information category is included based on the non-contact gesture information of first sensor array, based on second
The non-contact gesture information of sensor array and based on the contactless of first sensor array and second sensor array
Gesture information.
With reference to the embodiment of the present invention in a first aspect, in the third implementation of the first aspect of the embodiment of the present invention,
Before the first sensor array and second sensor array by being arranged side by side obtains user's non-contact gesture information
Also include step：
The contactless hand of user preset is obtained by the first sensor array and/or the second sensor array
Gesture information.
With reference to the embodiment of the present invention in a first aspect, in the 4th kind of implementation of the first aspect of the embodiment of the present invention,
After the first sensor array and second sensor array by being arranged side by side obtains user's non-contact gesture information
Also include step：
Show user's non-contact gesture information of the acquisition.
Additionally, for achieving the above object, embodiment of the present invention second aspect provides a kind of control device of terminal applies, institute
Stating device includes：First acquisition module, identification module, determining module and performing module；
First acquisition module, obtains user by the first sensor array and second sensor array that are arranged side by side
Non-contact gesture information；
The identification module, for by the non-contact gesture information of user preset, identifying that described first obtains mould
User's non-contact gesture information category that block is obtained；
The determining module, it is relative with user's non-contact gesture information category of identification module identification for determining
The control instruction answered；
Terminal applies, for the control instruction determined according to the determining module, are controlled behaviour by the performing module
Make.
With reference to the second aspect of the embodiment of the present invention, in the first implementation of the second aspect of the embodiment of the present invention,
The first sensor array includes that one or more sensors recognize panel；The second sensor array includes one or many
Individual sensor recognizes panel.
With reference to the second aspect of the embodiment of the present invention, in second implementation of the second aspect of the embodiment of the present invention,
User's non-contact gesture information category is included based on the non-contact gesture information of first sensor array, based on second
The non-contact gesture information of sensor array and based on the contactless of first sensor array and second sensor array
Gesture information.
With reference to the second aspect of the embodiment of the present invention, in the third implementation of the second aspect of the embodiment of the present invention,
Described device also includes the second acquisition module；
Second acquisition module, for being obtained by the first sensor array and/or the second sensor array
Take the default non-contact gesture information in family.
With reference to the second aspect of the embodiment of the present invention, in the 4th kind of implementation of the second aspect of the embodiment of the present invention,
Described device also includes display module；
The display module, for showing user's non-contact gesture information of the first acquisition module acquisition.
The control method of terminal applies provided in an embodiment of the present invention and device, by the capacitance type sensor being arranged side by side
Identification panel obtains user's non-contact gesture information, quickly and accurately terminal applies can be controlled with operation, generate list
The effect of double multiplexing；, without the need for being operated on a terminal screen, Consumer's Experience sense is strong for terminal use.
Description of the drawings
Fig. 1 is the hardware architecture diagram of an optional mobile terminal for realizing each embodiment of the invention；
Fig. 2 is the control method schematic flow sheet of the terminal applies that the present invention first is implemented；
Fig. 3 is the control method schematic flow sheet of the terminal applies that the present invention second is implemented；
Fig. 4 is the control method schematic flow sheet of the terminal applies that the present invention the 3rd is implemented；
Fig. 5 is the control device structural representation of the terminal applies that the present invention the 4th is implemented；
Fig. 6 is another structural representation of the control device of the terminal applies that the present invention the 4th is implemented；
Fig. 7 is that capacitance type sensor recognizes that panel recognizes the structural representation of gesture；
Fig. 8 is that capacitance type sensor recognizes that panel recognizes another structural representation of gesture.
The realization of the object of the invention, functional characteristics and advantage will be described further in conjunction with the embodiments referring to the drawings.
Specific embodiment
It should be appreciated that specific embodiment described herein is not intended to limit the present invention only to explain the present invention.
The mobile terminal of each embodiment of the invention is realized referring now to Description of Drawings.In follow-up description, use
For representing the suffix of such as " module ", " part " or " unit " of element only for being conducive to the explanation of the present invention, itself
Not specific meaning.Therefore, " module " mixedly can be used with " part ".
Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving
Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP
The mobile terminal of (portable media player), guider etc. and such as numeral TV, desktop computer etc. are consolidated
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for movement
Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is that the hardware configuration of an optional mobile terminal for realizing each embodiment of the invention is illustrated.
Mobile terminal 1 00 can include wireless communication unit 110, A/V (audio/video) input block 120, user input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups for illustrating
Part.More or less of component can alternatively be implemented.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assemblies, and which allows mobile terminal 1 00 and wireless communication system
Or the radio communication between network.For example, wireless communication unit can include broadcasting reception module 111, mobile communication module
112nd, at least one of wireless Internet module 113, short range communication module 114 and location information module 115.
Broadcasting reception module 111 receives broadcast singal and/or broadcast via broadcast channel from external broadcast management server
Relevant information.Broadcast channel can include satellite channel and/or terrestrial channel.Broadcast management server can be generated and sent
The broadcast singal generated before the server or reception of broadcast singal and/or broadcast related information and/or broadcast related information
And send it to the server of terminal.Broadcast singal can include TV broadcast singals, radio signals, data broadcasting
Signal etc..And, broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast phase
Pass information can also be provided via mobile communications network, and in this case, broadcast related information can be by mobile communication mould
Block 112 is receiving.Broadcast singal can be present in a variety of manners, and for example, which can be with the electronics of DMB (DMB)
The form of program guide (EPG), the electronic service guidebooks (ESG) of digital video broadcast-handheld (DVB-H) etc. and exist.Broadcast
Receiver module 111 can receive signal broadcast by using various types of broadcast systems.Especially, broadcasting reception module 111
Can be wide by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video
Broadcast-hand-held (DVB-H), the Radio Data System of forward link media (MediaFLO@), received terrestrial digital broadcasting integrated service
Etc. (ISDB-T) digit broadcasting system receives digital broadcasting.Broadcasting reception module 111 may be constructed such that and be adapted to provide for extensively
Broadcast the various broadcast systems and above-mentioned digit broadcasting system of signal.Via broadcasting reception module 111 receive broadcast singal and/
Or broadcast related information can be stored in memory 160 (or other types of storage medium).
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal can be logical including voice
Words signal, video calling signal or the various types of data for sending and/or receiving according to text and/or Multimedia Message.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by the module can including WLAN (WLAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
Short range communication module 114 is the module for supporting junction service.Some examples of short-range communication technology include indigo plant
Tooth TM, RF identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybee TM etc..
Location information module 115 is the module for checking or obtaining the positional information of mobile terminal.Location information module
Typical case be GPS (global positioning system).According to current technology, GPS module 115 is calculated from three or more satellites
Range information and correct time information and for calculate Information application triangulation, so as to according to longitude, latitude
Three-dimensional current location information is calculated highly accurately.Currently, defended using three for calculating the method for position and temporal information
The error of star and the position that calculated by using other satellite correction and temporal information.Additionally, GPS module 115
Can be by Continuous plus current location information in real time come calculating speed information.
A/V input blocks 120 are used for receiving audio or video signal.A/V input blocks 120 can include 121 He of camera
Microphone 122, the static images that 121 pairs, camera is obtained by image capture apparatus in Video Capture pattern or image capture mode
Or the view data of video is processed.Picture frame after process is may be displayed on display unit 151.Jing cameras 121 are processed
Carry out sending out during picture frame afterwards can be stored in memory 160 (or other storage mediums) or via wireless communication unit 110
Send, two or more cameras 121 can be provided according to the construction of mobile terminal.Microphone 122 can be in telephone calling model, note
Sound (voice data) is received via microphone in record pattern, speech recognition mode etc. operational mode, and can be by so
Acoustic processing be voice data.Audio frequency (voice) data after process can be converted in the case of telephone calling model can
The form output of mobile communication base station is sent to via mobile communication module 112.Microphone 122 can implement various types of making an uproar
Sound eliminates (or suppression) algorithm to eliminate the noise or dry that (or suppression) is produced during receiving and sending audio signal
Disturb.
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user input
Plant operation.User input unit 130 allows the various types of information of user input, and can include keyboard, metal dome, touch
Plate (for example, detection is due to the sensitive component of the change of touched and caused resistance, pressure, electric capacity etc.), roller, rocking bar etc.
Deng.Especially, when touch pad is superimposed upon on display unit 151 in the form of layer, touch-screen can be formed.
Sensing unit 140 detects the current state of mobile terminal 1 00, and (for example, mobile terminal 1 00 opens or closes shape
State), the position of mobile terminal 1 00, user is for the presence or absence of contact (that is, touch input), the mobile terminal of mobile terminal 1 00
100 orientation, the acceleration or deceleration movement of mobile terminal 1 00 and direction etc., and generate for controlling mobile terminal 1 00
The order of operation or signal.For example, when mobile terminal 1 00 is embodied as sliding-type mobile phone, sensing unit 140 can be sensed
The sliding-type phone is opened or is cut out.In addition, sensing unit 140 can detect power subsystem 190 whether provide electric power or
Whether person's interface unit 170 is coupled with external device (ED).
Interface unit 170 is connected the interface that can pass through as at least one external device (ED) with mobile terminal 1 00.For example,
External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing
Line FPDP, memory card port, the port for device of the connection with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be that storage uses each of mobile terminal 1 00 for verifying user
Kind of information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included
Etc..In addition, the device with identification module (hereinafter referred to as " identifying device ") can take the form of smart card, therefore, know
Other device can be connected with mobile terminal 1 00 via port or other attachment means.Interface unit 170 can be used for receive from
The input (for example, data message, electric power etc.) of external device (ED) and the input for receiving is transferred in mobile terminal 1 00
One or more elements can be used for the transmission data between mobile terminal and external device (ED).
In addition, when mobile terminal 1 00 is connected with external base, interface unit 170 can serve as allowing to pass through which by electricity
Power provides the path of mobile terminal 1 00 from base or can serve as allowing from base the various command signals being input into pass through which
It is transferred to the path of mobile terminal.Can serve as recognizing that mobile terminal is from the various command signals of base input or electric power
The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio frequency and/or tactile manner
Go out signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.).Output unit 150 can include showing
Unit 151, dio Output Modules 152, alarm unit 153 etc..
The information that display unit 151 is processed in may be displayed on mobile terminal 1 00.For example, when mobile terminal 1 00 is in electricity
During words call mode, display unit 151 can show and converse or other communicate (for example, text messaging, multimedia files
Download etc.) related user interface (UI) or graphic user interface (GUI).When mobile terminal 1 00 is in video calling pattern
Or during image capture mode, display unit 151 can show the image of capture and/or the image of reception, illustrate video or figure
UI or GUI of picture and correlation function etc..
Meanwhile, when the display unit 151 and touch pad touch-screen with formation superposed on one another in the form of layer, display unit
151 can serve as input unit and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
It is a kind of.Some in these displays may be constructed such that transparence to allow user from outside viewing, and this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
The embodiment wanted, mobile terminal 1 00 can include two or more display units (or other display devices), for example, move
Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used for detection and touch
Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal in call signal reception pattern, call mode, logging mode,
It is when under the isotypes such as speech recognition mode, broadcast reception mode, that wireless communication unit 110 is received or in memory 160
The voice data transducing audio signal of middle storage and it is output as sound.And, dio Output Modules 152 can be provided and movement
The audio output (for example, call signal receives sound, message sink sound etc.) of the specific function correlation that terminal 100 is performed.
Dio Output Modules 152 can include loudspeaker, buzzer etc..
Alarm unit 153 can provide output so that event is notified to mobile terminal 1 00.Typical event can be with
Including calling reception, message sink, key signals input, touch input etc..In addition to audio or video is exported, alarm unit
153 can provide output in a different manner with the generation of notification event.For example, alarm unit 153 can be in the form of vibrating
Output is provided, when calling, message or some other entrance communication (incomingcommunication) are received, alarm list
Unit 153 can provide tactile output (that is, vibrating) to notify to user.Tactile output as by providing, even if
When the mobile phone of user is in the pocket of user, user also can recognize that the generation of various events.Alarm unit 153
The output of the generation of notification event can be provided via display unit 151 or dio Output Modules 152.
Memory 160 can store software program for the process and control operation performed by controller 180 etc., Huo Zheke
With the data (for example, telephone directory, message, still image, video etc.) for temporarily storing own Jing outputs or will export.And
And, memory 160 can be storing the vibration of various modes with regard to exporting when touching and being applied to touch-screen and audio signal
Data.
Memory 160 can include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, many
Media card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..And, mobile terminal 1 00 can perform memory with by network connection
The network storage device cooperation of 160 store function.
The overall operation of the generally control mobile terminal of controller 180.For example, controller 180 is performed and voice call, data
The related control of communication, video calling etc. and process.In addition, controller 180 can be included for reproducing (or playback) many matchmakers
The multi-media module 181 of volume data, multi-media module 181 can be constructed in controller 180, or it is so structured that and control
Device 180 is separated.Controller 180 can be with execution pattern identifying processing, by the handwriting input for performing on the touchscreen or picture
Draw input and be identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit
Appropriate electric power needed for part and component.
Various embodiments described herein can be with use such as computer software, hardware or its any combination of calculating
Machine computer-readable recording medium is implementing.For hardware is implemented, embodiment described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Programming gate array (FPGA), processor, controller, microcontroller, microprocessor, it is designed to perform function described herein
At least one in electronic unit implementing, in some cases, can be implemented in controller 180 by such embodiment.
For software is implemented, the embodiment of such as process or function can with allow to perform the single of at least one function or operation
Software module is implementing.Software code can be come by the software application (or program) write with any appropriate programming language
Implement, perform during software code can be stored in memory 160 and by controller 180.
So far, own Jing describes mobile terminal according to its function.Below, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is used as showing
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
Based on above-mentioned mobile terminal hardware configuration, the inventive method each embodiment is proposed.
As shown in Fig. 2 first embodiment of the invention proposes a kind of control method of terminal applies, methods described includes step
Suddenly：
S1：User's non-contact gesture letter is obtained by the first sensor array and second sensor array that are arranged side by side
Breath；
In the present embodiment, first sensor array may include that one or more sensors recognize panel；Second sensor
Array may include that one or more sensors recognize panel.Sensor identification panel can recognize panel using capacitance type sensor.
First sensor array and second sensor array can be disposed side by side on the back side or side of terminal.By be arranged side by side
One sensor array and second sensor array, on the one hand can do more complicated non-contact gesture definition and non-contact gesture
Identification operation, on the other hand can produce the effect of single double multiplexing.
With reference to shown in Fig. 7, as an example, Fig. 7 is that 2 capacitance type sensors recognize that the structure of panel (i.e. S0, S1) is shown
It is intended to.2 capacitance type sensors identification panel S0, S1 of Fig. 7, are close to S0 to away from S0 for simulating finger, then close to S1
To away from S1；Horizontal axis representing time, vertical pivot represent that capacitance type sensor recognizes the capacitance of panel S0, S1；C0 is maximum saturation
Value, C3 are the minimum of a value for not having any gesture to be close to, and C1 and C2 is the division of capacitance threshold value；If desired for accuracy of identification is improved, can
Increase multiple capacitance threshold values.If desired for the diversity for strengthening gesture, the quantity that capacitance type sensor recognizes panel, example can be increased
Such as 4,8 or N number of capacitance type sensor identification panel.Define and contactless if desired for more complicated non-contact gesture is done
Gesture identification is operated, and can arrange multigroup sensor identification panel, and every group of sensor identification panel may include multiple capacitive sensings
Device recognizes panel.
Within the time of △ t, finger from S0 move to S1 when, its gesture is defined as similar touch-screen paddling operation, no
It is in contactless paddling operation to cross the operation.The definition of the value of its operation is as shown in figure 8, only arrange single electric capacity threshold here
Value, when more than capacitance threshold value when be 1, less than during capacitance threshold value for 0,1 represent be close to, 0 represent away from.
Multiple threshold values can be arranged to refine the accuracy being close to, 3 threshold values are such as set, then there can be four values,
00th, 01,10,11, corresponding respectively is close distance definition.
From the point of view of the example of Fig. 8, hand be first be close to S0 panels after be close to S1 panels, the Changing Pattern of S0 values is 0->1->
0, and the Changing Pattern of S1 values is 0->0->1.
S2：By the non-contact gesture information of user preset, user's non-contact gesture letter of the acquisition is identified
Breath classification；
In the present embodiment, user's non-contact gesture information category is included based on the contactless of first sensor array
Gesture information, the non-contact gesture information based on second sensor array and be based on first sensor array and second pass
The non-contact gesture information of sensor array.
Specifically, if the non-contact gesture of user is to lay particular emphasis on first sensor array (or second sensor battle array
Row), at this moment first sensor array (or second sensor array) can get the non-contact gesture information, non-according to this
Contact gesture information is further controlled operation to terminal applies.If the non-contact gesture of user is to lay particular emphasis on the first biography
Sensor array and second sensor array, at this moment first sensor array and second sensor array can get this simultaneously and non-connect
Terminal applies are further controlled operation according to the non-contact gesture information by touch gesture information.It is above-mentioned this non-to connect
Touch gesture identification process, may recognize that three kinds of different types of non-contact gestures, in actual applications widely.
Above-mentioned non-contact gesture is included, but are not limited to：Gesture is brandished in upper and lower, left and right, revolves clockwise, counterclockwise
Button gesture, gesture motion track etc..
S3：It is determined that the control instruction corresponding with user's non-contact gesture information category；
S4：According to the control instruction, terminal applies are controlled with operation.
In the present embodiment, terminal applies are controlled with operation, including the button that directly opening is matched with button operation
The corresponding application program of mode, or the switching between realizing opening and closing to systemic-function.The application program includes system
Pre-set programs or third party application；The function is the various functions supported on mobile-terminal platform, including to fixed connection
It is that people calls, sends note, open fixed document, open fixed network address, cleaning internal memory, take pictures, beat to constant connection people
Opening/closing wifi, beat opening/closing data network, beat opening/closing 3G, open/locking horizontal/vertical screen, beat opening/closing sound, opening/
Vibrations are closed, brightness is adjusted, is opened/close off-line mode, beat opening/closing bluetooth, beat opening/closing GPS, play opening/closing torch
Cylinder, shut down, restart, beat opening/closing music, beat opening/closing recorder, beat opening/closing radio, beat opening/closing voice assistant,
Screen locking, screenshotss, opening/closing synchronization is played, beat opening/closing setting option etc..
As shown in figure 3, second embodiment of the invention proposes a kind of control method of terminal applies, methods described includes step
Suddenly：
S1.0：The non-of user preset is obtained by the first sensor array and/or the second sensor array to connect
Touch gesture information.
In the present embodiment, user preset is obtained by first sensor array and/or second sensor array first
Non-contact gesture information, then believes the user's non-contact gesture information for obtaining as the non-contact gesture of user preset
Breath is stored, and is used during in order to subsequently being matched.
S1：User's non-contact gesture letter is obtained by the first sensor array and second sensor array that are arranged side by side
Breath；
S2：By the non-contact gesture information of user preset, user's non-contact gesture letter of the acquisition is identified
Breath classification；
S3：It is determined that the control instruction corresponding with user's non-contact gesture information category；
S4：According to the control instruction, terminal applies are controlled with operation.
As shown in figure 4, third embodiment of the invention proposes a kind of control method of terminal applies, methods described includes step
Suddenly：
S1：User's non-contact gesture letter is obtained by the first sensor array and second sensor array that are arranged side by side
Breath；
S1.1：Show user's non-contact gesture information of the acquisition；
In the present embodiment, it is non-user to be obtained in the first sensor array and second sensor array by being arranged side by side
After contact gesture information, timely user's non-contact gesture information of acquisition is shown, is carried out in order to user
Directly observation and judgement.
S2：By the non-contact gesture information of user preset, user's non-contact gesture letter of the acquisition is identified
Breath classification；
S3：It is determined that the control instruction corresponding with user's non-contact gesture information category；
S4：According to the control instruction, terminal applies are controlled with operation.
The control method of terminal applies provided in an embodiment of the present invention, recognizes face by the capacitance type sensor being arranged side by side
Plate obtains user's non-contact gesture information, and quickly and accurately terminal applies can be controlled with operation, generates single double multiple
Effect；, without the need for being operated on a terminal screen, Consumer's Experience sense is strong for terminal use.
The present invention further provides a kind of device.
A kind of control device of the terminal applies proposed for fourth embodiment of the invention with reference to Fig. 5, Fig. 5, device 200 are wrapped
Include：First acquisition module 201, identification module 202, determining module 203 and performing module 204；
First acquisition module 201, obtains user by the first sensor array and second sensor array that are arranged side by side
Non-contact gesture information；
In the present embodiment, first sensor array may include that one or more sensors recognize panel；Second sensor
Array may include that one or more sensors recognize panel.Sensor identification panel can recognize panel using capacitance type sensor.
First sensor array and second sensor array can be disposed side by side on the back side or side of terminal.By be arranged side by side
One sensor array and second sensor array, on the one hand can do more complicated non-contact gesture definition and non-contact gesture
Identification operation, on the other hand can produce the effect of single double multiplexing.
With reference to shown in Fig. 7, as an example, Fig. 7 is that 2 capacitance type sensors recognize that the structure of panel (i.e. S0, S1) is shown
It is intended to.2 capacitance type sensors identification panel S0, S1 of Fig. 7, are close to S0 to away from S0 for simulating finger, then close to S1
To away from S1；Horizontal axis representing time, vertical pivot represent that capacitance type sensor recognizes the capacitance of panel S0, S1；C0 is maximum saturation
Value, C3 are the minimum of a value for not having any gesture to be close to, and C1 and C2 is the division of capacitance threshold value；If desired for accuracy of identification is improved, can
Increase multiple capacitance threshold values.If desired for the diversity for strengthening gesture, the quantity that capacitance type sensor recognizes panel, example can be increased
Such as 4,8 or N number of capacitance type sensor identification panel.Define and contactless if desired for more complicated non-contact gesture is done
Gesture identification is operated, and can arrange multigroup sensor identification panel, and every group of sensor identification panel may include multiple capacitive sensings
Device recognizes panel.
Within the time of △ t, finger from S0 move to S1 when, its gesture is defined as similar touch-screen paddling operation, no
It is in contactless paddling operation to cross the operation.The definition of the value of its operation is as shown in figure 8, only arrange single electric capacity threshold here
Value, when more than capacitance threshold value when be 1, less than during capacitance threshold value for 0,1 represent be close to, 0 represent away from.
Multiple threshold values can be arranged to refine the accuracy being close to, 3 threshold values are such as set, then there can be four values,
00th, 01,10,11, corresponding respectively is close distance definition.
From the point of view of the example of Fig. 8, hand be first be close to S0 panels after be close to S1 panels, the Changing Pattern of S0 values is 0->1->
0, and the Changing Pattern of S1 values is 0->0->1.
Identification module 202, for by the non-contact gesture information of user preset, identifying the first acquisition module 201
User's non-contact gesture information category of acquisition；
In the present embodiment, user's non-contact gesture information category is included based on the contactless of first sensor array
Gesture information, the non-contact gesture information based on second sensor array and be based on first sensor array and second pass
The non-contact gesture information of sensor array.
Specifically, if the non-contact gesture of user is to lay particular emphasis on first sensor array (or second sensor battle array
Row), at this moment first sensor array (or second sensor array) can get the non-contact gesture information, non-according to this
Contact gesture information is further controlled operation to terminal applies.If the non-contact gesture of user is to lay particular emphasis on the first biography
Sensor array and second sensor array, at this moment first sensor array and second sensor array can get this simultaneously and non-connect
Terminal applies are further controlled operation according to the non-contact gesture information by touch gesture information.It is above-mentioned this non-to connect
Touch gesture identification process, may recognize that three kinds of different types of non-contact gestures, in actual applications widely.
Above-mentioned non-contact gesture is included, but are not limited to：Gesture is brandished in upper and lower, left and right, revolves clockwise, counterclockwise
Button gesture, gesture motion track etc..
Determining module 203, the user's non-contact gesture information category for determining the identification of identification module 202 are corresponding
Control instruction；
Terminal applies, for the control instruction determined according to determining module 203, are controlled operation by performing module 204.
In the present embodiment, terminal applies are controlled with operation, including the button that directly opening is matched with button operation
The corresponding application program of mode, or the switching between realizing opening and closing to systemic-function.The application program includes system
Pre-set programs or third party application；The function is the various functions supported on mobile-terminal platform, including to fixed connection
It is that people calls, sends note, open fixed document, open fixed network address, cleaning internal memory, take pictures, beat to constant connection people
Opening/closing wifi, beat opening/closing data network, beat opening/closing 3G, open/locking horizontal/vertical screen, beat opening/closing sound, opening/
Vibrations are closed, brightness is adjusted, is opened/close off-line mode, beat opening/closing bluetooth, beat opening/closing GPS, play opening/closing torch
Cylinder, shut down, restart, beat opening/closing music, beat opening/closing recorder, beat opening/closing radio, beat opening/closing voice assistant,
Screen locking, screenshotss, opening/closing synchronization is played, beat opening/closing setting option etc..
Refer again to shown in Fig. 6, further, device 200 may also include the second acquisition module 205；
Second acquisition module 205, for obtaining user preset by first sensor array and/or second sensor array
Non-contact gesture information.
In the present embodiment, user preset is obtained by first sensor array and/or second sensor array first
Non-contact gesture information, then believes the user's non-contact gesture information for obtaining as the non-contact gesture of user preset
Breath is stored, and is used during in order to subsequently being matched.
Refer again to shown in Fig. 6, further, device 200 may also include display module 206；
Display module 206, for showing user's non-contact gesture information of the acquisition of the first acquisition module 201.
In the present embodiment, it is non-user to be obtained in the first sensor array and second sensor array by being arranged side by side
After contact gesture information, timely user's non-contact gesture information of acquisition is shown, is carried out in order to user
Directly observation and judgement.
The control device of terminal applies provided in an embodiment of the present invention, recognizes face by the capacitance type sensor being arranged side by side
Plate obtains user's non-contact gesture information, and quickly and accurately terminal applies can be controlled with operation, generates single double multiple
Effect；, without the need for being operated on a terminal screen, Consumer's Experience sense is strong for terminal use.
It should be noted that herein, term " including ", "comprising" or its any other variant are intended to non-row
His property is included, so that a series of process, method, article or device including key elements not only include those key elements, and
And also include other key elements being not expressly set out, or also include for this process, method, article or device institute inherently
Key element.In the absence of more restrictions, the key element for being limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
Also there is other identical element in the process of key element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme is substantially done to prior art in other words
The part for going out contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), use so that a station terminal equipment including some instructions (can be mobile phone, computer, clothes
Business device, air-conditioner, or network equipment etc.) perform method described in each embodiment of the invention.
The preferred embodiments of the present invention are these are only, the scope of the claims of the present invention is not thereby limited, it is every using this
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of control method of terminal applies, it is characterised in that methods described includes step：
User's non-contact gesture information is obtained by the first sensor array and second sensor array that are arranged side by side；
By the non-contact gesture information of user preset, user's non-contact gesture information category of the acquisition is identified；
It is determined that the control instruction corresponding with user's non-contact gesture information category；
According to the control instruction, terminal applies are controlled with operation.
2. a kind of control method of terminal applies according to claim 1, it is characterised in that the first sensor array
Panel is recognized including one or more sensors；The second sensor array includes that one or more sensors recognize panel.
3. a kind of control method of terminal applies according to claim 1, it is characterised in that the contactless hand of the user
Gesture information category is included based on the non-contact gesture information of first sensor array, the noncontact based on second sensor array
Formula gesture information and the non-contact gesture information based on first sensor array and second sensor array.
4. the control method of a kind of terminal applies according to claim 1, it is characterised in that described by being arranged side by side
First sensor array and second sensor array also include step before obtaining user's non-contact gesture information：
The non-contact gesture letter of user preset is obtained by the first sensor array and/or the second sensor array
Breath.
5. the control method of a kind of terminal applies according to claim 1, it is characterised in that described by being arranged side by side
First sensor array and second sensor array also include step after obtaining user's non-contact gesture information：
Show user's non-contact gesture information of the acquisition.
6. a kind of control device of terminal applies, it is characterised in that described device includes：First acquisition module, identification module, really
Cover half block and performing module；
First acquisition module, obtains by the first sensor array that is arranged side by side and second sensor array that user is non-to be connect
Touch gesture information；
The identification module, for by the non-contact gesture information of user preset, identifying that first acquisition module is obtained
The user's non-contact gesture information category for taking；
The determining module, it is corresponding with user's non-contact gesture information category of identification module identification for determining
Control instruction；
Terminal applies, for the control instruction determined according to the determining module, are controlled operation by the performing module.
7. a kind of control device of terminal applies according to claim 6, it is characterised in that the first sensor array
Panel is recognized including one or more sensors；The second sensor array includes that one or more sensors recognize panel.
8. a kind of control device of terminal applies according to claim 6, it is characterised in that the contactless hand of the user
Gesture information category is included based on the non-contact gesture information of first sensor array, the noncontact based on second sensor array
Formula gesture information and the non-contact gesture information based on first sensor array and second sensor array.
9. the control device of a kind of terminal applies according to claim 6, it is characterised in that described device also includes second
Acquisition module；
Second acquisition module, is used for being obtained by the first sensor array and/or the second sensor array
The default non-contact gesture information in family.
10. the control device of a kind of terminal applies according to claim 6, it is characterised in that described device also includes aobvious
Show module；
The display module, for showing user's non-contact gesture information of the first acquisition module acquisition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610871724.2A CN106527685A (en) | 2016-09-30 | 2016-09-30 | Control method and device for terminal application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610871724.2A CN106527685A (en) | 2016-09-30 | 2016-09-30 | Control method and device for terminal application |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106527685A true CN106527685A (en) | 2017-03-22 |
Family
ID=58331246
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610871724.2A Pending CN106527685A (en) | 2016-09-30 | 2016-09-30 | Control method and device for terminal application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106527685A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109343694A (en) * | 2018-08-13 | 2019-02-15 | 浙江大学 | A kind of gesture recognition system and method for finger-guessing game finger-guessing game game |
| CN111656303A (en) * | 2017-12-20 | 2020-09-11 | 诺基亚技术有限公司 | Gesture control of data processing apparatus |
| CN112306360A (en) * | 2020-02-13 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Man-machine interaction method and device for learning machine |
| CN109002223B (en) * | 2018-08-29 | 2021-06-04 | 维沃移动通信有限公司 | Touch interface display method and mobile terminal |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102414645A (en) * | 2009-03-26 | 2012-04-11 | 诺基亚公司 | Apparatus including a sensor arrangement and methods of operating the same |
| US20120184247A1 (en) * | 2011-01-19 | 2012-07-19 | Lg Electronics Inc. | Electronic device and method of controlling the same |
| CN103067669A (en) * | 2011-10-24 | 2013-04-24 | 丽智科技股份有限公司 | Control system for integrating multiple groups of sensing plane data |
| CN103713735A (en) * | 2012-09-29 | 2014-04-09 | 华为技术有限公司 | Method and device of controlling terminal equipment by non-contact gestures |
| CN105357381A (en) * | 2015-10-28 | 2016-02-24 | 努比亚技术有限公司 | Terminal operation method and intelligent terminal |
| CN105807900A (en) * | 2014-12-30 | 2016-07-27 | 丰唐物联技术（深圳）有限公司 | Non-contact type gesture control method and intelligent terminal |
-
2016
- 2016-09-30 CN CN201610871724.2A patent/CN106527685A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102414645A (en) * | 2009-03-26 | 2012-04-11 | 诺基亚公司 | Apparatus including a sensor arrangement and methods of operating the same |
| US20120184247A1 (en) * | 2011-01-19 | 2012-07-19 | Lg Electronics Inc. | Electronic device and method of controlling the same |
| CN103067669A (en) * | 2011-10-24 | 2013-04-24 | 丽智科技股份有限公司 | Control system for integrating multiple groups of sensing plane data |
| CN103713735A (en) * | 2012-09-29 | 2014-04-09 | 华为技术有限公司 | Method and device of controlling terminal equipment by non-contact gestures |
| CN105807900A (en) * | 2014-12-30 | 2016-07-27 | 丰唐物联技术（深圳）有限公司 | Non-contact type gesture control method and intelligent terminal |
| CN105357381A (en) * | 2015-10-28 | 2016-02-24 | 努比亚技术有限公司 | Terminal operation method and intelligent terminal |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111656303A (en) * | 2017-12-20 | 2020-09-11 | 诺基亚技术有限公司 | Gesture control of data processing apparatus |
| CN109343694A (en) * | 2018-08-13 | 2019-02-15 | 浙江大学 | A kind of gesture recognition system and method for finger-guessing game finger-guessing game game |
| CN109343694B (en) * | 2018-08-13 | 2020-06-05 | 浙江大学 | Gesture recognition system and method for finger-guessing and punching game |
| CN109002223B (en) * | 2018-08-29 | 2021-06-04 | 维沃移动通信有限公司 | Touch interface display method and mobile terminal |
| CN112306360A (en) * | 2020-02-13 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Man-machine interaction method and device for learning machine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103811005B (en) | Mobile terminal and control method thereof | |
| CN106657667A (en) | Apparatus and method for lighting display screen | |
| KR101314679B1 (en) | Mobile terminal and method for operation control | |
| CN104991772B (en) | Remote operation bootstrap technique and device | |
| CN104915063B (en) | The method and apparatus for controlling intelligent terminal | |
| CN106569709A (en) | Device and method for controlling mobile terminal | |
| CN107256165A (en) | One kind application startup method, terminal and computer-readable recording medium | |
| CN106843740A (en) | Mobile terminal and mobile terminal touch control input method | |
| CN106775266A (en) | The method of mobile terminal and mobile terminal informing false-touch prevention | |
| CN106527928A (en) | Screen capturing control device and method and intelligent terminal | |
| CN106527685A (en) | Control method and device for terminal application | |
| CN106791187A (en) | A kind of mobile terminal and NFC method | |
| CN106681602A (en) | Terminal display control device and method | |
| CN106445148A (en) | Method and device for triggering terminal application | |
| CN106775336A (en) | A kind of content duplication method, device and terminal | |
| CN106527799A (en) | Method and device for preventing wrong operations of keys | |
| CN106384033A (en) | Screen off method and apparatus of terminal screen | |
| CN107133508A (en) | Application management method and mobile terminal | |
| CN106790941A (en) | A kind of way of recording and device | |
| CN106775381A (en) | The apparatus and method of adjustment screen touch area | |
| CN106776683A (en) | A kind of browser window changing method and terminal | |
| CN106775673A (en) | Many account entering devices and method of a kind of application program | |
| CN106569718A (en) | Screen lightening method and device | |
| CN106445150A (en) | Method and device for operating terminal application | |
| CN106559578B (en) | A kind of terminal screen goes out the method and device of screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170322 |
|
| RJ01 | Rejection of invention patent application after publication |