CN109308159A - Smart machine control method, device, system, electronic equipment and storage medium - Google Patents
Smart machine control method, device, system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109308159A CN109308159A CN201810960717.9A CN201810960717A CN109308159A CN 109308159 A CN109308159 A CN 109308159A CN 201810960717 A CN201810960717 A CN 201810960717A CN 109308159 A CN109308159 A CN 109308159A
- Authority
- CN
- China
- Prior art keywords
- gesture
- touch control
- control
- effective
- smart machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Present invention discloses a kind of smart machine control method, device, system, electronic equipment and computer readable storage mediums.The described method includes: the gesture in terminal device draws interface, the touch control gesture that user draws is received；Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains effective gesture that the touch control gesture matches；Associated control instruction is obtained according to effective gesture that the touch control gesture matches；The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.By the method, when user need to be adjusted smart machine to particular state, one step of touch control gesture only need to be drawn, solves the problems, such as that operating procedure is more in the prior art.
Description
Technical field
The present invention relates to equipment control technology field, in particular to a kind of smart machine control method, device, system, electricity
Sub- equipment and computer readable storage medium.
Background technique
Under the intelligentized trend of household electrical appliances, such as the smart machine of intelligent air condition, intelligent washing machine gradually replaces traditional family
Electricity, becomes a part of intelligent home network, and user can pass through corresponding in the mobile terminal of such as tablet computer, smart phone
Application program is remotely controlled smart machine.
Currently, several virtual keys are provided in the smart machine control interface of application program, are controlled with intelligent air condition
For interface, virtual key is adjusted comprising temperature, operational mode adjusts virtual key, wind direction adjusts virtual key, wind-force is adjusted
Virtual key.
User need to be adjusted respectively the temperature of intelligent air condition, operational mode, wind direction, wind-force by above-mentioned virtual key, right
In the user partially switched between different temperature, operational mode, wind direction, wind-force configuration as needed, adjustment process exists
The more problem of step, such as 25 DEG C, refrigeration, fixed wind direction, wind-force two are switched to from 27 DEG C, refrigeration, automatic wind direction, wind-force one
When, virtual key need to being adjusted by temperature and temperature being lowered 2 DEG C, virtual key is adjusted by wind direction and switches wind direction, passes through wind-force
It adjusts virtual key and switches wind-force.
Therefore, in existing smart machine control method, adjustment process there is a problem of more than operating procedure.
Summary of the invention
In order to solve the technical problem more than operating procedure in the related technology, the present invention provides a kind of smart machine controlling parties
Method, device, system, electronic equipment and computer readable storage medium.
A kind of smart machine control method is applied to terminal device, which comprises
Interface is drawn in the gesture of terminal device, receives the touch control gesture that user draws；
Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains the touch control gesture
The effective gesture to match；
Associated control instruction is obtained according to effective gesture that the touch control gesture matches；
The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.
In one exemplary embodiment, the gesture in terminal device draws interface, receives the touch-control hand that user draws
Gesture, comprising:
Interface is drawn in the third party's gesture being shown on terminal device, receives the touch control gesture；
Correspondingly, the effective gesture to be matched according to the touch control gesture obtains associated control instruction, comprising:
The smart machine control application for running on terminal device backstage obtains the control instruction according to effective gesture.
In one exemplary embodiment, the gesture in terminal device draws interface, receives the touch-control hand that user draws
Gesture, comprising:
The drafting operation triggered in interface is drawn in the gesture to user to be tracked；
During drafting operation is tracked, obtains the drafting and operate corresponding touch point on gesture drafting circle
Track sets when being moved in face；
The corresponding touch control gesture is generated according to track sets storage.
In one exemplary embodiment, described to be carried out in effective gesture that gesture library stores according to the touch control gesture
With lookup, effective gesture that the touch control gesture matches is obtained, comprising:
Effective gesture in the gesture library is traversed, track sets corresponding to effective gesture and the touch-control will be traversed
Track sets corresponding to gesture are matched, and obtain traversing the similarity between effective gesture and the touch control gesture；
Using in the terminal device with the highest effective gesture of the touch control gesture similarity as the touch control gesture
Match effective gesture.
In one exemplary embodiment, the method also includes:
For the similarity between traversed effective gesture and touch control gesture, highest similarity and specified threshold are carried out
Compare；
If the highest similarity is less than the specified threshold, determine that the touch control gesture is invalid gesture.
In one exemplary embodiment, the effective gesture to be matched according to the touch control gesture obtains associated control
Instruction, comprising:
Gesture mark is obtained, the gesture mark corresponds to effective gesture that the touch control gesture matches；
It obtains and identifies associated key assignments with the gesture, the key assignments indicates corresponding dynamic performed by the smart machine
Make；
The control instruction is generated according to the instruction of the key assignments.
In one exemplary embodiment, before the acquisition gesture mark, the method also includes:
The selection operation of user's triggering is received, is that the corresponding corresponding actions of the selection operation configure key assignments；
It triggers the effective gesture for drawing user in gesture input interface according to the selection operation to be acquired, to adopt
The effective gesture configuration gesture mark collected；
Carry out the associated storage of the gesture mark and the key assignments.
A kind of smart machine control method is applied to server-side, which comprises
Obtain the touch control gesture that user draws in terminal device；
Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains the touch control gesture
The effective gesture to match；
Associated control instruction is obtained according to effective gesture that the touch control gesture matches；
The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.
A kind of smart machine control device, is installed in terminal device, and described device includes:
Receiving module draws interface in the gesture of terminal device, receives the touch control gesture that user draws；
Searching module carries out matched and searched in effective gesture that gesture library stores according to the touch control gesture, obtains institute
State effective gesture that touch control gesture matches；
Instruction acquisition module obtains associated control instruction according to effective gesture that the touch control gesture matches；
Control module sends the control instruction to smart machine to control the smart machine and execute several accordingly move
Make.
A kind of smart machine control device, is installed in server-side, and described device includes:
Module is obtained, the touch control gesture that user draws in terminal device is obtained；
Matching module carries out matched and searched in effective gesture that gesture library stores according to the touch control gesture, obtains institute
State effective gesture that touch control gesture matches；
Fetching module obtains associated control instruction according to effective gesture that the touch control gesture matches；
Sending module sends the control instruction to smart machine to control the smart machine and execute several accordingly move
Make.
A kind of Control System of Intelligent, the system comprises:
Terminal device, for receiving the touch control gesture of user's drafting；
Server-side, the server-side are obtained by establishing network connection with the terminal device from the terminal device
The touch control gesture；
The server-side is configured as executing:
Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains the touch control gesture
The effective gesture to match；
Associated control instruction is obtained according to effective gesture that the touch control gesture matches；
The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.
A kind of electronic equipment, the electronic equipment include:
Processor；
Memory is stored with computer-readable instruction on the memory, and the computer-readable instruction is held by processor
When row, foregoing method is realized.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
Foregoing method is realized when row.
The technical solution that the embodiment of the present invention provides can include the following benefits:
The above method is searched in gesture library according to the drawn touch control gesture of user and obtains corresponding effective gesture, to intelligence
Equipment is sent with effective associated control instruction of gesture to control smart machine, if it is corresponding to execute smart machine
Dry movement.By the method, when user need to be adjusted smart machine to particular state, one step of touch control gesture only need to be drawn,
Solve the problems, such as that operating procedure is more in the prior art.
It should be understood that the above general description and the following detailed description are merely exemplary, this can not be limited
Invention.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention
Example, and in specification together principle for explaining the present invention.
Fig. 1 is a kind of schematic diagram of implementation environment shown according to an exemplary embodiment；
Fig. 2 is a kind of schematic diagram of the implementation environment shown according to another exemplary embodiment；
Fig. 3 is a kind of block diagram of device shown according to an exemplary embodiment；
Fig. 4 is a kind of flow chart of smart machine control method shown according to an exemplary embodiment；
Fig. 5 is the flow chart according to the details of the step 310 shown in Fig. 4 corresponding embodiment；
Fig. 6 is the flow chart according to the details of the step 330 shown in Fig. 4 corresponding embodiment；
Fig. 7 is a kind of flow chart of smart machine control method shown according to Fig. 6 corresponding embodiment；
Fig. 8 is the flow chart according to the details of the step 350 shown in Fig. 4 corresponding embodiment；
Fig. 9 is a kind of flow chart of smart machine control method shown according to Fig. 8 corresponding embodiment；
Figure 10 is a kind of block diagram of smart machine control device shown according to an exemplary embodiment；
Figure 11 is the block diagram according to the details of the receiving module shown in Figure 10 corresponding embodiment.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended
Described in claims, the example for the device and method that some aspects of the invention are consistent.
It is allowed users to by implementing this method by end firstly, the present invention discloses a kind of smart machine control method
Touch control gesture is drawn in end equipment controls smart machine.First implementation environment of the invention is illustrated below.
Fig. 1 is a kind of schematic diagram of implementation environment shown according to an exemplary embodiment.The implementation environment includes terminal
Equipment 110, gateway 150 and the smart machine 130 for being connected to gateway 150.
Wherein, terminal device 110 be it is implementable network connection and touch control electronic equipment, can be tablet computer,
Smart phone, herein without limiting.
Network connection is established between terminal device 110 and gateway 150, for example, leading between terminal device 110 and gateway 150
It crosses 2G/3G/4G/5G, Wi-Fi and establishes network connection, interacted by the network connection with gateway 150, enable user by end
End equipment 110 controls the smart machine 130 connecting with gateway 150 and executes movement.
Smart machine 130 is communicated by its own communication module configured with gateway 150, is realized between gateway 150
Interaction.For example, establishing a local area network by gateway 150, smart machine 130 accesses the gateway by connecting the gateway 150
In 150 local area network established.The local area network includes: ZigBee, bluetooth.
Smart machine 130 can be intelligence printer, intelligent facsimile machine, intelligent air condition, be configured with communication module (such as
ZigBee module, Wi-Fi module, bluetooth module) sensing equipment (such as human body sensor, door and window sensor, temperature and humidity sensing
Device, smoke alarm), herein without limiting.
Based on the interaction between terminal device 110, smart machine 130 and gateway 150, user is able to by terminal device
110, which implement touch control operation, realizes that the control to gateway 150 makes by controlling control of the realization of gateway 150 to smart machine 130
It obtains smart machine 130 and completes movement corresponding with the implemented touch control operation of user.So far, realize user's touch control gesture to gateway
150, the long-range control of smart machine 130.
Fig. 2 is a kind of schematic diagram of the implementation environment shown according to another exemplary embodiment.The implementation environment includes eventually
End equipment 110, server-side 140, gateway 150 and the smart machine 130 for being connected to gateway 150.
As shown in Fig. 2, establishing network connection, smart machine between terminal device 110, server-side 140 and gateway 150
130 are connected to gateway 150.
Server-side 140 can be a server, be also possible to the server cluster being made of multiple servers, can be with
It is the cloud computing center being made of multiple servers, herein without limiting.
Server-side 140 by the network connection with gateway 150, terminal device 110, with terminal device 110, gateway 150 into
Row data interaction.Terminal device 110 carries out data interaction by the network connection with gateway 150, with gateway 150.
Fig. 3 is a kind of block diagram of device shown according to an exemplary embodiment.As shown in figure 3, device 200 may include
Following one or more components: processing component 202, memory 204, power supply module 206, multimedia component 208, audio component
210, sensor module 214 and communication component 216.Device 200 can be above-mentioned terminal device 110.
The integrated operation of the usual control device 200 of processing component 202, such as with display, telephone call, data communication, phase
Machine operation and the associated operation of record operation etc..Processing component 202 may include one or more processors 218 to execute
Instruction, to complete all or part of the steps of following methods.In addition, processing component 202 may include one or more modules,
Convenient for the interaction between processing component 202 and other assemblies.For example, processing component 202 may include multi-media module, with convenient
Interaction between multimedia component 208 and processing component 202.
Memory 204 is configured as storing various types of data to support the operation in device 200.These data are shown
Example includes the instruction of any application or method for operating on the device 200.Memory 204 can be by any kind of
Volatibility or non-volatile memory device or their combination are realized, such as static random access memory (Static Random
Access Memory, abbreviation SRAM), electrically erasable programmable read-only memory (Electrically Erasable
Programmable Read-Only Memory, abbreviation EEPROM), Erasable Programmable Read Only Memory EPROM (Erasable
Programmable Read Only Memory, abbreviation EPROM), programmable read only memory (Programmable Red-
Only Memory, abbreviation PROM), read-only memory (Read-Only Memory, abbreviation ROM), magnetic memory, flash
Device, disk or CD.One or more modules are also stored in memory 204, which is configured to by this
One or more processors 218 execute, to complete all or part of step in method as follows.
Power supply module 206 provides electric power for the various assemblies of device 200.Power supply module 206 may include power management system
System, one or more power supplys and other with for device 200 generate, manage, and distribute the associated component of electric power.
Multimedia component 208 includes the screen of one output interface of offer between described device 200 and user.One
In a little embodiments, screen may include liquid crystal display (Liquid Crystal Display, abbreviation LCD) and touch panel.
If screen includes touch panel, screen may be implemented as touch screen, to receive input signal from the user.Touch panel
Including one or more touch sensors to sense the gesture on touch, slide, and touch panel.The touch sensor can be with
The boundary of a touch or slide action is not only sensed, but also detects duration associated with the touch or slide operation and pressure
Power.Screen can also include display of organic electroluminescence (Organic Light Emitting Display, abbreviation OLED).
Audio component 210 is configured as output and/or input audio signal.For example, audio component 210 includes a Mike
Wind (Microphone, abbreviation MIC), when device 200 is in operation mode, such as call model, logging mode and speech recognition mould
When formula, microphone is configured as receiving external audio signal.The received audio signal can be further stored in memory
204 or via communication component 216 send.In some embodiments, audio component 210 further includes a loudspeaker, for exporting
Audio signal.
Sensor module 214 includes one or more sensors, and the state for providing various aspects for device 200 is commented
Estimate.For example, sensor module 214 can detecte the state that opens/closes of device 200, the relative positioning of component, sensor group
Part 214 can be with the position change of 200 1 components of detection device 200 or device and the temperature change of device 200.Some
In embodiment, which can also include Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 216 is configured to facilitate the communication of wired or wireless way between device 200 and other equipment.Device
200 can access the wireless network based on communication standard, such as WiFi (Wireless-Fidelity, Wireless Fidelity).Show at one
In example property embodiment, communication component 216 receives broadcast singal or broadcast from external broadcasting management system via broadcast channel
Relevant information.In one exemplary embodiment, the communication component 216 further includes near-field communication (Near Field
Communication, abbreviation NFC) module, to promote short range communication.For example, radio frequency identification (Radio can be based in NFC module
Frequency Identification, abbreviation RFID) technology, Infrared Data Association (Infrared Data
Association, abbreviation IrDA) technology, ultra wide band (Ultra Wideband, abbreviation UWB) technology, Bluetooth technology and other skills
Art is realized.
In the exemplary embodiment, device 200 can be by one or more application specific integrated circuit (Application
Specific Integrated Circuit, abbreviation ASIC), it is digital signal processor, digital signal processing appts, programmable
Logical device, field programmable gate array, controller, microcontroller, microprocessor or other electronic components are realized, for executing
Following methods.
Fig. 4 is a kind of flow chart of smart machine control method shown according to an exemplary embodiment.This method application
In terminal device, as shown in figure 4, the method includes the steps of, completion can be executed by device 200 as shown in Figure 3, it can also be
It in above-mentioned implementation environment, is executed by terminal device 110, realizes the long-range control to smart machine 130.
Step 310, interface is drawn in the gesture of terminal device, receives the touch control gesture that user draws.
Smart machine control application is run on terminal device, and smart machine control application is mentioned by terminal device for user
It include that gesture draws interface for several interactive interfaces, in several interactive interfaces.
For interactive interface when terminal device is shown, terminal device receives user's operation, executes under the triggering of user's operation
Command adapted thereto so far completes the primary interaction between user and terminal device.
User is the manipulation by drawing certain gestures realization to smart machine, and controlling terminal equipment switches to gesture drafting
Interface.When terminal device shows that gesture draws interface, the touch control gesture that user draws terminal device is sensed.Touch control gesture is root
It is generated according to the corresponding touch point of user's touch control terminal equipment.
In a further exemplary embodiment, gesture drafting interface is also possible to third-party interactive interface, passes through the third
The interactive interface of side receives the touch control gesture that user draws.
Step 330, matched and searched is carried out in effective gesture that gesture library stores according to touch control gesture, obtains touch control gesture
The effective gesture to match.
By user gesture draw interface draw touch control gesture be compared with effective gesture in gesture library, obtain with
The matched effective gesture of touch control gesture.
Wherein, effective gesture can store in terminal device, also can store in gateway, server-side.Store effective hand
The storage region of gesture is gesture library, for gesture library be in terminal device, or in other equipment, the present invention without
It limits.
Effective gesture either user before step 310 typing into gesture library, be also possible to step 310 it
It is preceding that application generation is controlled by smart machine, it stores into gesture library, herein without limiting.
It is different from invalid gesture, effective gesture is stored in gesture library, is associated with following control instructions.
Step 350, associated control instruction is obtained according to effective gesture that touch control gesture matches.
Control instruction is the computer instruction that corresponding actions are executed for triggering terminal equipment control smart machine/gateway,
It can store in terminal device, be stored in server-side, herein without limiting.Control instruction in terminal device was both
It can be before step 310 according to user's operation configuration generation, be also possible to be controlled before step 310 by smart machine
Using what is automatically generated, herein without limiting.
Control instruction is configured as being associated with effective gesture in gesture library, and different effective gestures can be associated with same control
System instruction.For example, all Latin alphabet gestures (a, b, c, d, e ... ...) (can all be cut air-conditioning configuration with control instruction A
Shift to 27 DEG C, refrigeration, automatic wind direction, wind-force one) association, so that user is triggered the control by any Latin alphabet of drafting and refers to
A is enabled, memory burden is small.
After obtaining the effective gesture to match with touch control gesture, corresponding control instruction is obtained according to effective gesture.
In one exemplary embodiment, step 310 includes: to draw boundary in the third party's gesture being shown on terminal device
Face receives the touch control gesture.
Third party's gesture is drawn the third-party application that interface is operate on terminal device and (be can be except smart machine control
Any application outside system application) provided interactive interface.
Correspondingly, step 350 includes: to run on the smart machine control application on terminal device backstage according to effective hand
Gesture obtains the control instruction.
After obtaining the effective gesture to match with touch control gesture, the third-party application where third party's gesture draws interface will
The effective gesture obtained is transmitted to smart machine control application, and smart machine control application obtains corresponding control according to effective gesture
System instruction.
In this embodiment, user, if you need to control smart machine, can be used directly when using third-party application
Third party's gesture draws interface and is able to achieve smart machine control, without between third-party application and smart machine control application
It switches over.
Step 370, smart machine is controlled according to control instruction and executes corresponding actions.
Terminal device is controlled by above-mentioned control instruction, transmits number to gateway by the data transmission connection between gateway
According to control gateway transmits corresponding control signal to smart machine, and it is corresponding that smart machine will be controlled by control signal execution
Several movements.
Control instruction may is that
1, several smart machine close/opens are controlled；
2, several smart machines are controlled and switches to specified configuration respectively, for example, control air-conditioning switches to 27 DEG C, freezes, certainly
Dynamic wind direction, wind-force one, and, control illumination switches to that parlor lamp brightness is low, and bathroom light brightness is high；
In another example control air-conditioning is switched to and is automatically opened when room temperature is higher than 28 DEG C, and, infrared sensor was at 30 minutes
Human body is not detected inside, then closes the lamp of corresponding region.
In one exemplary embodiment, terminal device is controlled by above-mentioned control instruction, is passed by the data between gateway
Defeated connect to gateway transmits data, and control gateway executes corresponding actions, for example, starting is installed in the buzzer of gateway.
In a further exemplary embodiment, terminal device and smart machine directly establish connection, and terminal device is controlled by
Control instruction is stated, directly to smart machine transmission of control signals, smart machine is controlled and executes corresponding movement.
The present invention allows user to switch to specified configuration by drawing a touch control gesture to manipulate smart machine, is grasping
When control smart machine switches to specific configuration, without carrying out multi-pass operation by virtual key, in addition, user can also pass through one
Secondary touch control gesture manipulates several smart machines and switches to corresponding configuration respectively, without different intelligent equipment operation and control interface it
Between switch, reduce operating procedure.
Fig. 5 is the flow chart according to the details of the step 310 shown in Fig. 4 corresponding embodiment.As shown in figure 5, step 310 is wrapped
It includes:
Step 311, the drafting operation triggered in interface is drawn in gesture to user to be tracked.
When gesture draws interface display, terminal device senses the touch control operation of user, the corresponding touch point of the touch control operation
Touch control operation is followed to change in the coordinate that gesture draws interface, which is to draw operation.
Step 313, during drafting operation is tracked, acquisition drafting operation corresponds to touch point and draws in interface in gesture
Track sets when mobile.
During drafting operation is tracked, obtains and draws the coordinate that touch point corresponding to operation draws interface in gesture,
Several touch point coordinates are acquired as the discrete point operated in corresponding track sets is drawn, obtain track sets, it is collected
Discrete point is more, and the precision of gained track sets is higher.When acquiring discrete point can acquisition spaced apart it is primary, can also be with
Separated in time acquisition is primary, herein without limiting.
The track for drawing operation can be continuously, such as the track of " 1 " shape, be also possible to discontinuous, such as " 10 "
The track of shape.The present invention not to draw operation track be defined, draw operation track can be Chinese-character stroke (such as
" one ", " Shu " ...), Arabic numerals (such as " 1 ", " 2 " ...), the Latin alphabet (such as " a ", " b " ...), geometric graph
Shape (such as " △ ", " " ...), irregular figure/symbol (such as " √ ", " > " ...).
Step 315, corresponding touch control gesture is generated according to track sets storage.
Fig. 6 is the flow chart according to the details of the step 330 shown in Fig. 4 corresponding embodiment.As shown in fig. 6, step 330 is wrapped
It includes:
Step 331, effective gesture in gesture library is traversed, track sets corresponding to effective gesture and touch-control will be traversed
Track sets corresponding to gesture are matched, and obtain traversing the similarity between effective gesture and touch control gesture.
Traversing similarity between effective gesture and touch control gesture can be by calculating more than the minimum between track sets
String value obtains, and can also be obtained by square Euclidean distance calculated between track sets, herein without limiting.
Step 333, using in terminal device with the highest effective gesture of touch control gesture similarity as the matching of touch control gesture
Effective gesture.
To avoid the occurrence of the mistake that number " 1 " is for example determined as to alphabetical " l ", calculate separately to obtain touch control gesture and gesture
The similarity of all effective gestures in library, using effective gesture corresponding to highest similarity in gained similarity as with touch control gesture
Matched effective gesture, the i.e. effective gesture of the matching of touch control gesture.
In a further exemplary embodiment, to reduce calculation amount, effective gesture in touch control gesture and gesture library is successively calculated
Similarity, when touch control gesture and be polled to effective gesture similarity be greater than a designated value (such as 95%) when, that is, determine touching
Control gesture is matched with effective gesture.
Fig. 7 is a kind of flow chart of smart machine control method shown according to Fig. 6 corresponding embodiment.As shown in fig. 7, should
Smart machine control method is further comprising the steps of.
Step 410, it for the similarity between traversed effective gesture and touch control gesture, by highest similarity and specifies
Threshold value is compared.
User may draw and gesture library in all lower touch control gesture of effective gesture similarity therefore show one
In example property embodiment, in addition to effective gesture in traversal gesture library, also by gained highest similarity and specified threshold (such as
90%) it is compared.
Step 430, if highest similarity is less than specified threshold, determine that touch control gesture is invalid gesture.
For being judged as the touch control gesture of invalid gesture, the touch control gesture Trig control signal for forbidding user to be drawn is produced
It is raw.
The drawn touch control gesture of user and the highest similarity of gesture effective in gesture library are lower, when for example, 60%, no
It is triggered for the touch control gesture and generates control signal, to prevent smart machine operating status caused by user misoperation from changing.
Fig. 8 is the flow chart according to the details of the step 350 shown in Fig. 4 corresponding embodiment.As shown in figure 8, step 350 is wrapped
It includes:
Step 351, gesture mark is obtained, gesture mark corresponds to effective gesture that touch control gesture matches.
Effective gesture in gesture library all has its gesture mark respectively, and different effective gestures has different gesture marks
Know.
Step 353, it obtains and identifies associated key assignments, corresponding actions performed by key assignments indicating intelligent equipment with gesture.
By the incidence relation between gesture mark and key assignments, finds gesture and identify corresponding key assignments, different gestures
The associated key assignments of mark is different.
Step 355, control instruction is generated according to the instruction of key assignments.
Key assignments is corresponding with control instruction.After control instruction generates, smart machine will be controlled by the corresponding control of control instruction
Signal executes corresponding several movements.
Fig. 9 is a kind of flow chart of smart machine control method shown according to Fig. 8 corresponding embodiment.As shown in figure 9,
Before step 351, the smart machine control method is further comprising the steps of.
Step 510, the selection operation of user's triggering is received, configures key assignments for the corresponding corresponding actions of the selection operation.
Selection operation refers to, user before typing gesture, be arranged the gesture by the operation of trigger action.It is exemplary one
In embodiment, several interactive interfaces are provided for user, user operates in interactive interface, and the movement that need to be triggered is arranged.
It is the performed movement distribution key assignments of the corresponding smart machine of selection operation under the triggering of selection operation.
Step 530, the acquisition that user in gesture input interface draws effective gesture is triggered according to selection operation, is user
The effective gesture configuration gesture mark drawn.
Under the triggering of selection operation, the gesture that also user draws in acquisition gesture input interface is deposited as effective gesture
It is stored in gesture library, when which is stored in gesture library, distributes gesture mark for the gesture.
In gesture input interface, discrete point collected is more, and precision is higher.A spacing can be spaced when acquiring discrete point
It is primary from acquisition, it can also be acquired with separated in time once, herein without limiting.
Step 550, the associated storage of gesture mark and key assignments is carried out.
When the drawn gesture of user is stored in gesture library, also by the gesture distributed for gesture mark and aforementioned key assignments
Associated storage establishes the indirect association between effective gesture and the performed movement of smart machine.
In one exemplary embodiment, the present invention also provides a kind of smart machine control method, it is applied to server-side, it can be with
It in above-mentioned implementation environment, is executed by server-side 140, realizes the long-range control to smart machine 130.The described method includes:
Obtain the touch control gesture that user draws in terminal device；
Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains the touch control gesture
The effective gesture to match；
Associated control instruction is obtained according to effective gesture that the touch control gesture matches；
The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.
This method by server-side according to touch control gesture obtain control instruction, can reduce from user draw touch control gesture to
Time needed for the controlled execution movement of smart machine.
Correspondingly, the present invention provides a kind of Control System of Intelligent, the system comprises:
Terminal device, for receiving the touch control gesture of user's drafting；
Server-side, the server-side are obtained by establishing network connection with the terminal device from the terminal device
The touch control gesture；
The server-side is configured as executing:
Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains the touch control gesture
The effective gesture to match；
Associated control instruction is obtained according to effective gesture that the touch control gesture matches；
The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.
Following apparatus embodiment can be used for executing above method embodiment.
Figure 10 is a kind of block diagram of smart machine control device shown according to an exemplary embodiment.The device is installed in
Terminal device, as shown in Figure 10, the device comprise the following modules.
Receiving module 610 draws interface for the gesture in terminal device, receives the touch control gesture that user draws.
Searching module 630, for carrying out matched and searched in effective gesture that gesture library stores according to the touch control gesture,
Obtain effective gesture that the touch control gesture matches.
Instruction acquisition module 650, effective gesture for being matched according to the touch control gesture obtain associated control and refer to
It enables.
Control module 670 executes corresponding actions for controlling the smart machine according to the control instruction.
Figure 11 is the block diagram according to the details of the receiving module shown in Figure 10 corresponding embodiment.As shown in figure 11, mould is received
Block 610 includes with lower unit.
Tracing unit 611 is tracked for drawing the drafting triggered in interface operation in the gesture to user.
Track acquiring unit 613, for during drafting operation is tracked, obtaining the corresponding touching of drafting operation
Control point draws track sets when moving in interface in the gesture.
Storage unit 615, for generating the corresponding touch control gesture according to track sets storage.
The present invention also provides a kind of smart machine control devices, are installed in server-side, and described device includes:
Module is obtained, the touch control gesture that user draws in terminal device is obtained；
Matching module carries out matched and searched in effective gesture that gesture library stores according to the touch control gesture, obtains institute
State effective gesture that touch control gesture matches；
Fetching module obtains associated control instruction according to effective gesture that the touch control gesture matches；
Sending module sends the control instruction to smart machine to control the smart machine and execute several accordingly move
Make.
Optionally, the present invention also provides a kind of electronic equipment, the electronic equipment includes:
Processor；
Memory is stored with computer-readable instruction on the memory, and the computer-readable instruction is held by processor
When row, foregoing method is realized.
The electronic equipment can be Fig. 3 shown device 200.
In the exemplary embodiment, a kind of computer readable storage medium is additionally provided, computer program is stored thereon with,
The computer program realizes foregoing method when being executed by processor.
It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and
And various modifications and change can executed without departing from the scope.The scope of the present invention is limited only by the attached claims.
Claims (13)
1. a kind of smart machine control method is applied to terminal device, which is characterized in that the described method includes:
Interface is drawn in the gesture of terminal device, receives the touch control gesture that user draws；
Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains the touch control gesture phase
The effective gesture matched；
Associated control instruction is obtained according to effective gesture that the touch control gesture matches；
The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.
2. receiving and using the method according to claim 1, wherein the gesture in terminal device draws interface
The touch control gesture that family is drawn, comprising:
Interface is drawn in the third party's gesture being shown on terminal device, receives the touch control gesture；
Correspondingly, the effective gesture to be matched according to the touch control gesture obtains associated control instruction, comprising:
The smart machine control application for running on terminal device backstage obtains the control instruction according to effective gesture.
3. method according to claim 1 or 2, which is characterized in that the gesture in terminal device draws interface, receives
The touch control gesture that user draws, comprising:
The drafting operation triggered in interface is drawn in the gesture to user to be tracked；
During drafting operation is tracked, obtains the drafting and operate corresponding touch point in gesture drafting interface
Track sets when mobile；
The corresponding touch control gesture is generated according to track sets storage.
4. method according to claim 1 or 2, which is characterized in that described to be stored according to the touch control gesture in gesture library
Effective gesture in carry out matched and searched, obtain effective gesture that the touch control gesture matches, comprising:
Effective gesture in the gesture library is traversed, track sets corresponding to effective gesture and the touch control gesture will be traversed
Corresponding track sets are matched, and obtain traversing the similarity between effective gesture and the touch control gesture；
Using in the terminal device with the highest effective gesture of the touch control gesture similarity as the matching of the touch control gesture
Effective gesture.
5. according to the method described in claim 4, it is characterized in that, the method also includes:
For the similarity between traversed effective gesture and touch control gesture, highest similarity and specified threshold are compared
Compared with；
If the highest similarity is less than the specified threshold, determine that the touch control gesture is invalid gesture.
6. method according to claim 1 or 2, which is characterized in that it is described matched according to the touch control gesture it is effective
Gesture obtains associated control instruction, comprising:
Gesture mark is obtained, the gesture mark corresponds to effective gesture that the touch control gesture matches；
It obtains and identifies associated key assignments with the gesture, the key assignments indicates corresponding actions performed by the smart machine；
The control instruction is generated according to the instruction of the key assignments.
7. according to the method described in claim 6, it is characterized in that, the acquisition gesture mark before, the method also includes:
The selection operation of user's triggering is received, is that the corresponding corresponding actions of the selection operation configure key assignments；
The acquisition that user in gesture input interface draws effective gesture is triggered according to the selection operation, is had for what user drew
Imitate gesture configuration gesture mark；
Carry out the associated storage of the gesture mark and the key assignments.
8. a kind of smart machine control method is applied to server-side, which is characterized in that the described method includes:
Obtain the touch control gesture that user draws in terminal device；
Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains the touch control gesture phase
The effective gesture matched；
Associated control instruction is obtained according to effective gesture that the touch control gesture matches；
The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.
9. a kind of smart machine control device, is installed in terminal device, which is characterized in that described device includes:
Receiving module draws interface in the gesture of terminal device, receives the touch control gesture that user draws；
Searching module carries out matched and searched in effective gesture that gesture library stores according to the touch control gesture, obtains the touching
Effective gesture that control gesture matches；
Instruction acquisition module obtains associated control instruction according to effective gesture that the touch control gesture matches；
Control module sends the control instruction to smart machine to control the smart machine and execute corresponding several movements.
10. a kind of smart machine control device, is installed in server-side, which is characterized in that described device includes:
Module is obtained, the touch control gesture that user draws in terminal device is obtained；
Matching module carries out matched and searched in effective gesture that gesture library stores according to the touch control gesture, obtains the touching
Effective gesture that control gesture matches；
Fetching module obtains associated control instruction according to effective gesture that the touch control gesture matches；
Sending module sends the control instruction to smart machine to control the smart machine and execute corresponding several movements.
11. a kind of Control System of Intelligent, which is characterized in that the system comprises:
Terminal device, for receiving the touch control gesture of user's drafting；
Server-side, the server-side is by establishing network connection with the terminal device, described in terminal device acquisition
Touch control gesture；
The server-side is configured as executing:
Matched and searched is carried out in effective gesture that gesture library stores according to the touch control gesture, obtains the touch control gesture phase
The effective gesture matched；
Associated control instruction is obtained according to effective gesture that the touch control gesture matches；
The control instruction is sent to smart machine to control the smart machine and execute corresponding several movements.
12. a kind of electronic equipment, which is characterized in that the electronic equipment includes:
Processor；
Memory is stored with computer-readable instruction on the memory, when the computer-readable instruction is executed by processor,
Realize method according to any one of claim 1 to 8.
13. a kind of computer readable storage medium, which is characterized in that be stored thereon with computer program, the computer program
Method according to any one of claim 1 to 8 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810960717.9A CN109308159B (en) | 2018-08-22 | 2018-08-22 | Intelligent device control method, device and system, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810960717.9A CN109308159B (en) | 2018-08-22 | 2018-08-22 | Intelligent device control method, device and system, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109308159A true CN109308159A (en) | 2019-02-05 |
| CN109308159B CN109308159B (en) | 2023-01-17 |
Family
ID=65223928
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810960717.9A Active CN109308159B (en) | 2018-08-22 | 2018-08-22 | Intelligent device control method, device and system, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109308159B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110110616A (en) * | 2019-04-19 | 2019-08-09 | 出门问问信息科技有限公司 | A kind of electronic equipment and control method |
| CN112306235A (en) * | 2020-09-25 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Gesture operation method, device, equipment and storage medium |
| CN112489413A (en) * | 2020-11-27 | 2021-03-12 | 京东方科技集团股份有限公司 | Control method and system of remote controller, storage medium and electronic equipment |
| CN112486379A (en) * | 2020-11-10 | 2021-03-12 | 佛山市百斯特电器科技有限公司 | Control method of washing equipment and washing equipment |
| CN112732154A (en) * | 2019-10-29 | 2021-04-30 | 福建天泉教育科技有限公司 | Method for extending touch function in remote control and storage medium |
| CN113050435A (en) * | 2019-12-27 | 2021-06-29 | 施德朗（广州）电气科技有限公司 | Control method, device and system for Internet of things and smart home and storage medium |
| CN115904057A (en) * | 2021-08-17 | 2023-04-04 | 华为技术有限公司 | Equipment control method and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309612A (en) * | 2013-05-30 | 2013-09-18 | 北京小米科技有限责任公司 | Method, device and equipment for processing information of graphic interface text field of mobile equipment |
| CN105393205A (en) * | 2013-06-04 | 2016-03-09 | 三星电子株式会社 | Electronic device and method for controlling applications in the electronic device |
| CN105791927A (en) * | 2014-12-16 | 2016-07-20 | 上海天脉聚源文化传媒有限公司 | Smart television gesture control method and system |
| CN106681499A (en) * | 2016-12-14 | 2017-05-17 | 珠海格力电器股份有限公司 | Automobile control method and device based on mobile terminal and electronic equipment |
-
2018
- 2018-08-22 CN CN201810960717.9A patent/CN109308159B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309612A (en) * | 2013-05-30 | 2013-09-18 | 北京小米科技有限责任公司 | Method, device and equipment for processing information of graphic interface text field of mobile equipment |
| CN105393205A (en) * | 2013-06-04 | 2016-03-09 | 三星电子株式会社 | Electronic device and method for controlling applications in the electronic device |
| CN105791927A (en) * | 2014-12-16 | 2016-07-20 | 上海天脉聚源文化传媒有限公司 | Smart television gesture control method and system |
| CN106681499A (en) * | 2016-12-14 | 2017-05-17 | 珠海格力电器股份有限公司 | Automobile control method and device based on mobile terminal and electronic equipment |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110110616A (en) * | 2019-04-19 | 2019-08-09 | 出门问问信息科技有限公司 | A kind of electronic equipment and control method |
| CN112732154A (en) * | 2019-10-29 | 2021-04-30 | 福建天泉教育科技有限公司 | Method for extending touch function in remote control and storage medium |
| CN113050435A (en) * | 2019-12-27 | 2021-06-29 | 施德朗（广州）电气科技有限公司 | Control method, device and system for Internet of things and smart home and storage medium |
| CN113050435B (en) * | 2019-12-27 | 2024-05-28 | 施德朗（广州）电气科技有限公司 | Control method, device and system for Internet of things and intelligent home and storage medium |
| CN112306235A (en) * | 2020-09-25 | 2021-02-02 | 北京字节跳动网络技术有限公司 | Gesture operation method, device, equipment and storage medium |
| CN112306235B (en) * | 2020-09-25 | 2023-12-29 | 北京字节跳动网络技术有限公司 | Gesture operation method, device, equipment and storage medium |
| CN112486379A (en) * | 2020-11-10 | 2021-03-12 | 佛山市百斯特电器科技有限公司 | Control method of washing equipment and washing equipment |
| CN112489413A (en) * | 2020-11-27 | 2021-03-12 | 京东方科技集团股份有限公司 | Control method and system of remote controller, storage medium and electronic equipment |
| CN115904057A (en) * | 2021-08-17 | 2023-04-04 | 华为技术有限公司 | Equipment control method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109308159B (en) | 2023-01-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109308159A (en) | Smart machine control method, device, system, electronic equipment and storage medium | |
| KR102181588B1 (en) | Method and apparatus for optimal control based on motion-voice multi-modal command | |
| US10431218B2 (en) | Integration and probabilistic control of electronic devices | |
| CN107528753B (en) | Intelligent household voice control method, intelligent equipment and device with storage function | |
| CN103529778B (en) | A kind of intelligent home furnishing control method, device and system | |
| CN113170000B (en) | Equipment control method, device, system, electronic equipment and cloud server | |
| CN101982842B (en) | Remote controller for intelligent appliances and networking control method | |
| US20140253483A1 (en) | Wall-Mounted Multi-Touch Electronic Lighting- Control Device with Capability to Control Additional Networked Devices | |
| CN206097455U (en) | Speech recognition controlgear | |
| CN109188927A (en) | Appliance control method, device, gateway and storage medium | |
| CN108600059A (en) | Apparatus control method and Related product | |
| CN106814639A (en) | Speech control system and method | |
| CN109901698B (en) | Intelligent interaction method, wearable device, terminal and system | |
| WO2017166066A1 (en) | Infrared remote control method, terminal and apparatus | |
| CN105872655A (en) | Device control methods and apparatuses, and electronic devices | |
| CN105549398B (en) | Control system and method for driving corresponding device at fixed time according to trigger strategy | |
| CN104750498A (en) | Method for controlling mouse module and electronic device | |
| CN114019807A (en) | Data processing method, device, system, equipment and readable storage medium | |
| CN107490979A (en) | Home terminal control method, equipment and system | |
| CN108762489A (en) | Control method, data glove, system based on data glove and storage medium | |
| CN106789456A (en) | A kind of home equipment control method and device | |
| CN111158246A (en) | Intelligent household appliance control system, device, method, medium and equipment | |
| CN112866068A (en) | Intelligent interaction system, interaction terminal and control platform | |
| CN108415572B (en) | Module control method and device applied to mobile terminal and storage medium | |
| CN207502942U (en) | home terminal control device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |