CN103838372A - Intelligent function start/stop method and system for intelligent glasses - Google Patents
Intelligent function start/stop method and system for intelligent glasses Download PDFInfo
- Publication number
- CN103838372A CN103838372A CN201310597866.0A CN201310597866A CN103838372A CN 103838372 A CN103838372 A CN 103838372A CN 201310597866 A CN201310597866 A CN 201310597866A CN 103838372 A CN103838372 A CN 103838372A
- Authority
- CN
- China
- Prior art keywords
- blinkpunkt
- user
- intelligent
- position relationship
- eyes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an intelligent function start/stop method and system for a pair of intelligent glasses. The intelligent function start method includes the fixation point detection step, the relation judgment step, the time judgment step and the intelligent function start step, wherein in the fixation point detection step, a fixation point of a user is detected; in the relation judgment step, whether the fixation point and a target object meet a position relation or not is judged; in the time judgment step, when the fixation point and the target point meet the position relation, whether the duration time for meeting the position relation reaches a first threshold valve or not is judged; in the intelligent function start step, when the duration time for meeting the position relation reaches the first threshold valve, the intelligent functions of the intelligent glasses are started. Through the method and system, the intelligent functions of the intelligent glasses can be started or stopped conveniently, and moreover influences on the intelligent function implementation process are avoided.
Description
Technical field
The present invention relates to intelligent Wearable apparatus field, relate in particular to a kind of intelligent function On/Off method and On/Off system of intelligent glasses.
Background technology
Compared with traditional PC or touch panel device, intelligent Wearable equipment is subject to more and more users' extensive welcome, and likely greatly changes modern's life style.As a kind of main intelligent Wearable equipment, intelligent glasses can carry out forming corresponding projects images with Graphics Processing result in Intelligent treatment the fixing two-dimentional viewing area in the user visual field to the visible scene image of user, this projects images covers on reality scene, and user can see through this projects images simultaneously and see reality scene.
For example, in the time that user wants to obtain the answer of a mathematical formulae, this user can write this mathematical formulae on a piece of paper, is identified this mathematical formulae, is calculated result and this result be presented in the projects images of intelligent glasses by intelligent glasses.Again for example, in the time that user wants to identify a region in reality scene and adds comment tag, this user can utilize gesture to draw a circle to approve the profile in this region, is identified the region that this gesture draws a circle to approve and this region contour and respective labels are presented in the projects images of intelligent glasses by intelligent glasses.
In prior art, user likely manipulates the above-mentioned intelligent function of this intelligent glasses in the situation that not using conventional mouse or keyboard, and for example some intelligent glasses product is provided with the Trackpad that manipulates glasses intelligent function for user in picture frame side.
Summary of the invention
The technology that the object of this invention is to provide a kind of convenient operation control intelligent glasses intelligent function startup and close, and avoid the implementation procedure of intelligent function to impact.
For solving the problems of the technologies described above, according to an aspect of the present invention, provide a kind of intelligent function starting method of intelligent glasses, described method comprises:
Blinkpunkt detecting step, detection user's blinkpunkt;
Be related to determining step, judge whether described blinkpunkt and an object meet a position relationship;
Time determining step, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches a first threshold; And
Intelligent function setting up procedure, when meeting the duration of described position relationship while reaching described first threshold, starts the described intelligent function of described intelligent glasses.
According to another aspect of the present invention, also provide a kind of intelligent function starting method of intelligent glasses, described method comprises:
Blinkpunkt detecting step, detection user's blinkpunkt;
Be related to determining step, judge whether described blinkpunkt and an object meet a position relationship; And
Intelligent function setting up procedure, in the time that described blinkpunkt and described object meet described position relationship, starts the described intelligent function of described intelligent glasses.
According to another aspect of the present invention, also provide a kind of intelligent function of intelligent glasses to start system, described system comprises:
Blinkpunkt checkout equipment, for detection of user's blinkpunkt;
Be related to judgment device, for judging whether described blinkpunkt and an object meet a position relationship;
Time judgment device, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches a first threshold; And
Intelligent function starting outfit, for when meeting the duration of described position relationship while reaching described first threshold, starts the described intelligent function of described intelligent glasses.
According to another aspect of the present invention, also provide a kind of intelligent function of intelligent glasses to start system, described system comprises:
Blinkpunkt checkout equipment, for detection of user's blinkpunkt;
Be related to judgment device, for judging whether described blinkpunkt and an object meet a position relationship; And
Intelligent function starting outfit, in the time that described blinkpunkt and described object meet described position relationship, starts the described intelligent function of described intelligent glasses.
According to another aspect of the present invention, also provide a kind of intelligent function method for closing of intelligent glasses, described method comprises:
Blinkpunkt detecting step, detection user's blinkpunkt;
Be related to determining step, judge whether described blinkpunkt and an object meet a position relationship;
Time determining step, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches one the 3rd threshold value; And
Intelligent function is closed step, when meeting the duration of described position relationship while reaching described the 3rd threshold value, closes the described intelligent function of described intelligent glasses.
According to another aspect of the present invention, also provide a kind of intelligent function method for closing of intelligent glasses, described method comprises:
Blinkpunkt detecting step, detection user's blinkpunkt;
Be related to determining step, judge whether described blinkpunkt and an object meet a position relationship; And
Intelligent function is closed step, in the time that described blinkpunkt and described object meet described position relationship, closes the described intelligent function of described intelligent glasses.
According to another aspect of the present invention, also provide a kind of intelligent function shutdown system of intelligent glasses, described system comprises:
Blinkpunkt checkout equipment, for detection of user's blinkpunkt;
Be related to judgment device, for judging whether described blinkpunkt and an object meet a position relationship;
Time judgment device, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches one the 3rd threshold value; And
Intelligent function closing device, for when meeting the duration of described position relationship while reaching described the 3rd threshold value, closes the described intelligent function of described intelligent glasses.
According to another aspect of the present invention, also provide a kind of intelligent function shutdown system of intelligent glasses, described system comprises:
Blinkpunkt checkout equipment, for detection of user's blinkpunkt;
Be related to judgment device, for judging whether described blinkpunkt and an object meet a position relationship; And
Intelligent function closing device, in the time that described blinkpunkt and described object meet described position relationship, closes the described intelligent function of described intelligent glasses.
According to another aspect of the present invention, also provide a kind of intelligent glasses, it comprises that the intelligent function in the present invention starts system or intelligent function shutdown system.
The intelligent function of intelligent glasses can be opened or close to method and system of the present invention easily, and avoided the implementation procedure of intelligent function to impact.
It is for the form introduction to simplify is by some concepts that further describe in following embodiment that foregoing invention content is provided.Content of the present invention is not intended to identify key feature or the essential feature of theme required for protection, is not also intended to the scope for helping to determine theme required for protection.In addition, theme required for protection is not limited to solve the realization of any or all technical matters of mentioning in arbitrary part of the present invention.
Brief description of the drawings
Fig. 1 is the structural drawing that in the specific embodiment of the invention, intelligent function starts system;
Fig. 2 is the structural drawing of blinkpunkt checkout equipment in intelligent function startup system in the specific embodiment of the invention;
Fig. 3 is a structural drawing that is related to judgment device in the specific embodiment of the invention in intelligent function startup system;
Fig. 4 is another structural drawing that is related to judgment device in the specific embodiment of the invention in intelligent function startup system;
Fig. 5 is the flow chart of steps of intelligent function starting method in the specific embodiment of the invention;
Fig. 6 is the process flow diagram of blinkpunkt detecting step in intelligent function starting method in the specific embodiment of the invention;
Fig. 7 is a process flow diagram that is related to determining step in the specific embodiment of the invention in intelligent function starting method;
Fig. 8 is another process flow diagram that is related to determining step in the specific embodiment of the invention in intelligent function starting method;
Fig. 9 is the structural drawing that in another embodiment of the present invention, intelligent function starts system;
Figure 10 is the flow chart of steps of intelligent function starting method in another embodiment of the present invention;
Figure 11 is the structural drawing of intelligent function shutdown system in the specific embodiment of the invention;
Figure 12 is the structural drawing of blinkpunkt checkout equipment in intelligent function shutdown system in the specific embodiment of the invention;
Figure 13 is a structural drawing that is related to judgment device in the specific embodiment of the invention in intelligent function shutdown system;
Figure 14 is another structural drawing that is related to judgment device in the specific embodiment of the invention in intelligent function shutdown system;
Figure 15 is the flow chart of steps of intelligent function method for closing in the specific embodiment of the invention;
Figure 16 is the process flow diagram of blinkpunkt detecting step in intelligent function method for closing in the specific embodiment of the invention;
Figure 17 is a process flow diagram that is related to determining step in the specific embodiment of the invention in intelligent function method for closing;
Figure 18 is another process flow diagram that is related to determining step in the specific embodiment of the invention in intelligent function method for closing;
Figure 19 is the structural drawing of intelligent function shutdown system in another embodiment of the present invention;
Figure 20 is the flow chart of steps of intelligent function method for closing in another embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing (in some accompanying drawings, identical label represents identical element) and embodiment, the specific embodiment of the present invention is described in further detail.Following examples are used for illustrating the present invention, but are not used for limiting the scope of the invention.
It will be understood by those skilled in the art that the term such as " first ", " second " in the present invention, only for distinguishing different step, equipment or module etc., neither represents any particular technology implication, also do not represent the inevitable logical order between them.
Inventor studies discovery, as the intelligent glasses of realizing common Wearable functions of the equipments simultaneously, does not in fact need to carry out constantly its all intelligent functions, has so both been unfavorable for energy-conservationly, also can impact the realization of its general function.Although some intelligent glasses is provided with the Trackpad of opening or closing intelligent function for user in picture frame side, but be subject to the restriction of intelligent Wearable equipment physical size, the operation of these Trackpads is also inconvenient, and goes to manipulate the likely realization to some intelligent function of these Trackpads (for example identifying finger motion locus etc.) with hand and impact.As can be seen here, the technology that need to propose a kind of convenient operation control intelligent eyes intelligent function startup and close, and avoid the implementation procedure of intelligent function to impact.
Consider that while carrying out certain intelligent function, user can watch instrument or the position of carrying out this intelligent function conventionally attentively; in technology disclosed by the invention; user's blinkpunkt is detected and judges position relationship and the duration of fixation between this blinkpunkt and default object, will meet certain positional relationship and time conditions as the trigger mechanism that starts or close corresponding intelligent function.Like this, user only just can start or close specific intelligent function by watching attentively of sight, the both hands of having liberated user, and operation is very easy, avoided intelligent function to realize the impact causing simultaneously.
According to a specific embodiment of the present invention, as shown in Figure 1, provide a kind of intelligent function of intelligent glasses to start system 100, described system 100 comprises:
Be related to judgment device 120, for judging whether described blinkpunkt and an object meet a position relationship;
Intelligent function starting outfit 140, for when meeting the duration of described position relationship while reaching described first threshold, starts the described intelligent function of described intelligent glasses.
Below, 1-4 introduces above-mentioned intelligent function and starts each functions of the equipments of system 100 by reference to the accompanying drawings.
(1) blinkpunkt checkout equipment 110, for detection of user's blinkpunkt.
In an embodiment, as shown in Figure 2, this blinkpunkt checkout equipment 110 can further comprise:
Direction of gaze determining device 113, for determining the direction of gaze of eyes of user according to the described image of eyes of user; And
Blinkpunkt pick-up unit 114, for determining described user's described blinkpunkt according to described scene image and described direction of gaze.
This scene filming apparatus 111 can be arranged on the front surface of intelligent glasses, for take in real time the scene image that user sees by this intelligent glasses to front, the user visual field.In a kind of possible embodiment of the present invention, this scene filming apparatus 111 can be embodied as at least one miniature video camera, and it can carry out the shooting of scene image by different resolution or different frame per second.In the another kind of possible embodiment of the present invention, this scene filming apparatus 111 directly use sense photoimaging device is realized, the such as device such as CCD or CMOS.
This eyes filming apparatus 112 can be taken the image of eyes of user, the video image of such as eyes etc. in real time.This eye image can comprise the information such as pupil position.In a kind of possible embodiment of the present invention, this eyes filming apparatus 112 can be embodied as at least one miniature video camera, and it can carry out the shooting of eye image by different resolution or different frame per second.In the another kind of possible embodiment of the present invention, this eyes filming apparatus 112 directly use sense photoimaging device is realized, the such as device such as CCD or CMOS.
In a kind of possible embodiment of the present invention, in order not affect the viewing experience of user to outer scene, and for make device can portable application on Wearable equipment, this eyes filming apparatus 112 also comprises a spectral module, is used to form eyes and observes the light bang path between scene and between eyes and video camera or image device.Can fold light path like this, reduce the volume of equipment, not affect as far as possible other experience of user simultaneously.Preferably, in the present embodiment, this spectral module can and be observed between scene at eyes, and the light for viewed in transmittance scene to eyes, transmits the light of eyes to video camera or image device.This spectral module can be implemented as spectroscope, light splitting optical waveguide (comprising optical fiber) or other applicable spectrophotometric unit.
This direction of gaze determining device 113 can utilize the processor in intelligent glasses to realize, and it determines the direction of gaze of eyes of user according to the captured eye image of this eyes filming apparatus 112.Preferably, in the time that eye image comprises pupil position information, this direction of gaze determining device 113 can directly be determined according to this pupil position information the direction of gaze of eyes of user.
This blinkpunkt pick-up unit 114 can utilize the processor in intelligent glasses to realize, and it can determine user's blinkpunkt according to the captured scene image of this scene filming apparatus 111 and the determined direction of gaze of this direction of gaze determining device 113.
It will be appreciated by those skilled in the art that, above-mentioned scene filming apparatus 111 and eyes filming apparatus 112 can carry out constantly, in real time the synchronous shooting of respective image in the time that user observes outer scene image, with by corresponding scene image with eye image offers direction of gaze determining device 113 and blinkpunkt pick-up unit 114 carries out subsequent treatment, therefore in the time detecting a certain moment user blinkpunkt for detection of the scene image of this blinkpunkt and for the eye image that obtains this direction of gaze synchronous shooting of this moment.
(2) be related to judgment device 120, for judging whether described blinkpunkt and an object meet a position relationship.
In the specific embodiment of the invention, this object can set in advance.For the ease of this object is identified, can will be pre-stored in a database for the relevant information of identifying this object, this database can be integrated on intelligent glasses, also can be arranged at the far-end that can communicate with intelligent glasses.
In one embodiment of the present invention, this object can be that user observes a point of fixity or the fixed object in scene, now can choose the point of fixity carried out in intelligent function place scene or fixed object as this object.For example, in the time that user wishes to write mathematical formulae and utilize intelligent glasses to identify on fixing blank, can be using any corner position of blank or arbitrary top corner regions as object.It will be understood by those skilled in the art that in order to identify this object in scene, this fixed position information of this object need to be deposited in the database of intelligent glasses or far-end.
In another embodiment of the present invention, this object can be that user observes a motor point or the moving object in scene, now can choose the motor point of carrying out in intelligent function place scene or moving object as this object.For example, when user wishes with finger when doing area identification and utilizing intelligent glasses to identify this region, can be for example, using the specific identifier (finger ring) of wearing on finger fingertip, finger in particular pose or even finger as object.It will be understood by those skilled in the art that in order to identify this object in scene, the characteristic information of this object need to be deposited in the database of intelligent glasses or far-end.
In the above in two kinds of embodiments, in the time that default object is a point (fixing or motion) or an object (fixing or motion), this is related to judgment device 120 judges whether the distance of detected user's blinkpunkt and this object is less than a Second Threshold, meets the distance that described position relationship refers to user's blinkpunkt and this object and is less than this Second Threshold.This Second Threshold can be set according to the actual requirements by those skilled in the art, for example, be set to 5cm.Be appreciated that this Second Threshold arranges less, user's blinkpunkt just needs could meet this position relationship near this object more accurately.
Preferably, as shown in Figure 3, this is related to that judgment device 120 can further comprise scope determining device 121 and object judgment means 122, wherein scope determining device 121 is for determining a scope that is less than this Second Threshold with this blinkpunkt distance, and object judgment means 122 is for judging whether this object appears within the scope of this.For example, the object identifying information that this object judgment means 122 prestores in can reference database is identified in the determined scope of scope determining device 121, to judge whether this object appears within the scope of this.This is related to that scope determining device 121 and object judgment means 122 in judgment device 120 all can utilize the processor in intelligent glasses to realize.
In another embodiment of the present invention, this object can be that user observes a fixed area or the moving region in scene, now can choose the fixed area carried out in intelligent function place scene or moving region as this object.For example, in the time that user wishes to obtain passage and utilize intelligent glasses to translate on fixing blank or portable panel computer, can be using the regional extent of this fixing blank or panel computer as object.It will be understood by those skilled in the art that in order to identify this object in scene, the characteristic information of this object need to be deposited in the database of intelligent glasses or far-end.
In the above-described embodiment, in the time that default object is a fixed area or moving region, this is related to judgment device 120 judges whether detected user's blinkpunkt drops in the scope of this object, meets the described blinkpunkt that described position relationship refers to described user and drops in the scope of described object.
Preferably, as shown in Figure 4, this is related to that judgment device 120 can further comprise object recognition device 123 and blinkpunkt judgment means 124, wherein object recognition device 123 is identified this object for the scene of seeing user, and the object identifying information for example prestoring in reference database regional extent to this object in scene is identified; Blinkpunkt judgment means 124 is for judging whether user's blinkpunkt drops in the scope of this object.This is related to that object recognition device 123 and blinkpunkt judgment means 124 in judgment device 120 all can utilize the processor in intelligent glasses to realize.
(3) time judgment device 130, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches a first threshold.
This time judgment device 130 can utilize the processor in intelligent glasses to realize.In the time that default object is a point or an object, if this is related to that judgment device 120 judges the distance of detected user's blinkpunkt and this object and be less than this Second Threshold, this time judgment device 130 starts timing, for example start a timer, this timing is less than in duration of this Second Threshold and carries out continuously in both distances, and judges at any time whether this duration reaches this first threshold; In the time that default object is a fixed area or moving region, if this is related to that judgment device 120 judges detected user's blinkpunkt and drop in the scope of this object, this time judgment device 130 starts timing, this timing is carried out in the duration in blinkpunkt drops on the scope of this object continuously, and judges at any time whether this duration reaches this first threshold.
This first threshold can be set according to the actual requirements by those skilled in the art, for example, be set to 2 seconds.Be appreciated that this threshold value setting larger, user's blinkpunkt and this object just need to meet for more time this position relationship can start corresponding intelligent function.
(4) intelligent function starting outfit 140, for when meeting the duration of described position relationship while reaching described first threshold, starts the described intelligent function of described intelligent glasses.
This intelligent function starting outfit 140 can utilize the processor in intelligent glasses to realize.Particularly, in the time that default object is a point or an object, if the distance that this time judgment device 130 is judged this user's blinkpunkt and this object is less than the duration of this Second Threshold while reaching this first threshold, intelligent function starting outfit 140 starts corresponding intelligent function; In the time that default object is a fixed area or moving region, if this time judgment device 130 is judged duration in the scope that this user's blinkpunkt drops on this object while reaching this first threshold, intelligent function starting outfit 140 starts corresponding intelligent function.
According to another embodiment of the present invention, as shown in Figure 5, provide a kind of intelligent function starting method of intelligent glasses, described method comprises:
S210: blinkpunkt detecting step, detection user's blinkpunkt;
S220: be related to determining step, judge whether described blinkpunkt and an object meet a position relationship;
S230: time determining step, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches a first threshold; And
S240: intelligent function setting up procedure, when meeting the duration of described position relationship while reaching described first threshold, starts the described intelligent function of described intelligent glasses.
Below, 5-8 introduces each step function of above-mentioned intelligent function starting method by reference to the accompanying drawings.
S210: blinkpunkt detecting step, detection user's blinkpunkt.
In an embodiment, this blinkpunkt detecting step S210 can utilize this blinkpunkt checkout equipment 110 to carry out, and as shown in Figure 6, this blinkpunkt detecting step S210 further comprises:
S211: scene is taken step, takes the scene image that user sees by described intelligent glasses;
S212: eyes are taken step, takes the image of eyes of user;
S213: direction of gaze determining step, determine the direction of gaze of eyes of user according to the described image of eyes of user; And
S214: blinkpunkt detecting step, determine described user's described blinkpunkt according to described scene image and described direction of gaze.
This scene is taken step S211 and can be utilized scene filming apparatus 111 to carry out, and takes in real time the scene image that user sees by this intelligent glasses to front, the user visual field.
These eyes are taken step S212 and can be utilized eyes filming apparatus 112 to carry out, and take in real time the image of eyes of user.This eye image can comprise the information such as pupil position.
This direction of gaze determining step S213 can utilize direction of gaze determining device 113 to carry out, and determines the direction of gaze of eyes of user according to captured eye image in eyes shooting step S212.Preferably, in the time that eye image comprises pupil position information, in this direction of gaze determining step S213, can directly determine according to this pupil position information the direction of gaze of eyes of user.
This blinkpunkt detecting step S214 can utilize blinkpunkt pick-up unit 114 to carry out, according to the blinkpunkt of taking scene image captured in step S211 in scene and determined direction of gaze can be determined user in direction of gaze determining step S213.
S220: be related to determining step, judge whether described blinkpunkt and an object meet a position relationship.
In the specific embodiment of the invention, this object can set in advance.Therefore preferably, in the intelligent function starting method in the present invention, can further comprise that one sets in advance the step of this object.For the ease of this object is identified, can further comprise an object information storing step, will prestore for the relevant information of identifying this object, be for example pre-stored in a database.
In one embodiment of the present invention, this object can be that user observes a point of fixity or the fixed object in scene, now can choose the point of fixity carried out in intelligent function place scene or fixed object as this object.In another embodiment of the present invention, this object can be that user observes a motor point or the moving object in scene, now can choose the motor point of carrying out in intelligent function place scene or moving object as this object.
In the above in two kinds of embodiments, in the time that default object is a point (fixing or motion) or an object (fixing or motion), be related at this whether the distance that judges detected user's blinkpunkt and this object in determining step S220 is less than a Second Threshold, meet the distance that described position relationship refers to user's blinkpunkt and this object and be less than this Second Threshold.This threshold value can be set according to the actual requirements by those skilled in the art.
Preferably, as shown in Figure 7, this is related to that determining step S220 can further comprise scope determining step S221 and object determining step S222, wherein scope determining step S221 determines a scope that is less than this threshold value with this blinkpunkt distance, and object determining step S222 judges whether this object appears within the scope of this.
In another embodiment of the present invention, this object can be that user observes a fixed area or the moving region in scene, now can choose the fixed area carried out in intelligent function place scene or moving region as this object.
In the above-described embodiment, in the time that default object is a fixed area or moving region, this is related to determining step S220 judges whether detected user's blinkpunkt drops in the scope of this object, meets the described blinkpunkt that described position relationship refers to described user and drops in the scope of described object.
Preferably, as shown in Figure 8, this is related to that determining step S220 can further comprise object identification step S223 and blinkpunkt determining step S224, in the scene that wherein object identification step S223 sees user, identify this object, blinkpunkt determining step S224 judges whether user's blinkpunkt drops in the scope of this object.
S230: time determining step, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches a first threshold.
Particularly, in the time that default object is a point or an object, if be related to that at this distance of judging this user's blinkpunkt and this object in determining step S220 is less than this Second Threshold, in time determining step S230, start timing, this timing is less than in duration of this Second Threshold and carries out continuously in both distances, and judges at any time whether this duration reaches this first threshold; In the time that default object is a fixed area or moving region, if be related to that at this judging this user's blinkpunkt in determining step S220 drops in the scope of this object, in time determining step S230, start timing, this timing is carried out in the duration in this blinkpunkt drops on the scope of this object continuously, and judges at any time whether this duration reaches this first threshold.This first threshold can be set according to the actual requirements by those skilled in the art.
S240: intelligent function setting up procedure, when meeting the duration of described position relationship while reaching described first threshold, starts the described intelligent function of described intelligent glasses.
Particularly, in the time that default object is a point or an object, if judge duration that the distance of this user's blinkpunkt and this object is less than this Second Threshold while reaching this first threshold in this time determining step S230, start corresponding intelligent function in intelligent function setting up procedure S240; In the time that default object is a fixed area or moving region, if judge duration in the scope that this user's blinkpunkt drops on this object while reaching this first threshold in this time determining step S230, start corresponding intelligent function in intelligent function setting up procedure S240.
According to another embodiment of the present invention, as shown in Figure 9, provide a kind of intelligent function of intelligent glasses to start system 100 ', described system 100 ' comprising:
Be related to judgment device 120, for judging whether described blinkpunkt and an object meet a position relationship; And
Intelligent function starting outfit 140 ', in the time that whether described blinkpunkt and described object meet described position relationship, starts the described intelligent function of described intelligent glasses.
It is visible that the intelligent function of introducing before contrast starts system 100, and this intelligent function starts the corresponding function that system 100 ' has been removed the time judgment device in intelligent function startup system 100 and adjusted intelligent function starting outfit.In fact, it be that intelligent function starts in system 100 is a kind of special case of 0 o'clock by the set of time of first threshold that this intelligent function starts system 100 ', in system operational process, omit the judgement of the duration to meeting position relationship, once this blinkpunkt and this object meet this position relationship and just start corresponding intelligent function.
Corresponding, according to another embodiment of the present invention, as shown in figure 10, providing a kind of intelligent function starting method of intelligent glasses, described method comprises:
S210: blinkpunkt detecting step, detection user's blinkpunkt;
S220: be related to determining step, judge whether described blinkpunkt and an object meet a position relationship; And
S240 ' intelligent function setting up procedure, in the time that whether described blinkpunkt and described object meet described position relationship, starts the described intelligent function of described intelligent glasses.
The intelligent function starting method of introducing before contrast is visible, and this method has been removed time determining step and adjusted the corresponding function of intelligent function setting up procedure.In fact, the method is to be a kind of special case of 0 o'clock by the set of time of the first threshold in intelligent function starting method before, in method implementation, omit the judgement of the duration to meeting position relationship, once this blinkpunkt and this object meet this position relationship and just start corresponding intelligent function.
According to a specific embodiment of the present invention, as shown in figure 11, provide a kind of intelligent function shutdown system 300 of intelligent glasses, described system 300 comprises:
Be related to judgment device 320, for judging whether described blinkpunkt and an object meet a position relationship;
Intelligent function closing device 340, for when meeting the duration of described position relationship while reaching described the 3rd threshold value, closes the described intelligent function of described intelligent glasses.
Below, 11-14 introduces each functions of the equipments of above-mentioned intelligent function shutdown system 300 by reference to the accompanying drawings.
(1) blinkpunkt checkout equipment 310, for detection of user's blinkpunkt.
In an embodiment, as shown in figure 12, this blinkpunkt checkout equipment 310 can further comprise: scene filming apparatus 311, the scene image of seeing by described intelligent glasses for taking user; Eyes filming apparatus 312, for taking the image of eyes of user; Direction of gaze determining device 313, for determining the direction of gaze of eyes of user according to the described image of eyes of user; And blinkpunkt pick-up unit 314, for determine described user's described blinkpunkt according to described scene image and described direction of gaze.
(2) be related to judgment device 320, for judging whether described blinkpunkt and an object meet a position relationship.
In the specific embodiment of the invention, this object can set in advance.For the ease of this object is identified, can will be pre-stored in a database for the relevant information of identifying this object, this database can be integrated on intelligent glasses, also can be arranged at the far-end that can communicate with intelligent glasses.
In one embodiment of the present invention, this object can be that user observes a point of fixity or the fixed object in scene, now can choose the point of fixity carried out in intelligent function place scene or fixed object as this object.In another embodiment of the present invention, this object can be that user observes a motor point or the moving object in scene, now can choose the motor point of carrying out in intelligent function place scene or moving object as this object.
In the above in two kinds of embodiments, in the time that default object is a point (fixing or motion) or an object (fixing or motion), this is related to judgment device 320 judges whether the distance of detected user's blinkpunkt and this object is greater than one the 4th threshold value, meets the distance that described position relationship refers to user's blinkpunkt and this object and is greater than the 4th threshold value.The 4th threshold value can be set according to the actual requirements by those skilled in the art, for example, be set as 10cm.Be appreciated that the 4th threshold value setting larger, user's blinkpunkt just need to could meet this position relationship further from this object.
Preferably, as shown in figure 13, this is related to that judgment device 320 can further comprise scope determining device 321 and object judgment means 322, wherein scope determining device 321 is for determining a scope that is not more than the 4th threshold value with this blinkpunkt distance, and object judgment means 322 is for judging whether this object appears within the scope of this.For example, the object identifying information that this object judgment means 322 prestores in can reference database is identified in the determined scope of scope determining device 321, to judge whether this object appears within the scope of this, do not appear at the distance that can judge user's blinkpunkt and this object within the scope of this and be greater than the 4th threshold value when judging this object.This is related to that scope determining device 321 and object judgment means 322 in judgment device 320 all can utilize the processor in intelligent glasses to realize.
In another embodiment of the present invention, this object can be that user observes a fixed area or the moving region in scene, now can choose the fixed area carried out in intelligent function place scene or moving region as this object.
In the above-described embodiment, in the time that default object is a fixed area or moving region, this is related to judgment device 320 judges whether detected user's blinkpunkt exceeds in the scope of this object, meets the described blinkpunkt that described position relationship refers to described user and exceeds in the scope of described object.
Preferably, as shown in figure 14, this is related to that judgment device 320 can further comprise object recognition device 323 and blinkpunkt judgment means 324, wherein object recognition device 123 is identified this object for the scene of seeing user, and the object identifying information for example prestoring in reference database regional extent to this object in scene is identified; Blinkpunkt judgment means 324 is for judging whether user's blinkpunkt drops in the scope of this object, do not drop within the scope of this and can judge the scope that user's blinkpunkt has exceeded this object when judging this object.This is related to that object recognition device 323 and blinkpunkt judgment means 324 in judgment device 320 all can utilize the processor in intelligent glasses to realize.
(3) time judgment device 330, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches one the 3rd threshold value.
This time judgment device 330 can utilize the processor in intelligent glasses to realize.In the time that default object is a point or an object, if this is related to that judgment device 320 judges the distance of detected user's blinkpunkt and this object and be greater than the 4th threshold value, this time judgment device 330 starts timing, for example start a timer, this timing is less than in duration of the 4th threshold value and carries out continuously in both distances, and judges at any time whether this duration reaches the 3rd threshold value; In the time that default object is a fixed area or moving region, if this is related to that judgment device 320 judges the scope that detected user's blinkpunkt exceeds this object, this time judgment device 330 starts timing, this timing is carried out continuously within this blinkpunkt exceeds duration of this object scope, and judges at any time whether this duration reaches the 3rd threshold value.
The 3rd threshold value can be set according to the actual requirements by those skilled in the art, for example, be set to 3 seconds.Be appreciated that this threshold value setting larger, user's blinkpunkt and this object just need to meet for more time this position relationship can close corresponding intelligent function.
(4) intelligent function closing device 340, for when meeting the duration of described position relationship while reaching described the 3rd threshold value, closes the described intelligent function of described intelligent glasses.
This intelligent function closing device 340 can utilize the processor in intelligent glasses to realize.Particularly, in the time that default object is a point or an object, if the distance that this time judgment device 330 is judged this user's blinkpunkt and this object is greater than the duration of the 4th threshold value while reaching the 3rd threshold value, intelligent function closing device 340 is closed corresponding intelligent function; In the time that default object is a fixed area or moving region, if this time judgment device 330 is judged duration that this user's blinkpunkt exceeds the scope of this object while reaching the 3rd threshold value, intelligent function closing device 340 is closed corresponding intelligent function.
According to another embodiment of the present invention, as shown in figure 15, provide a kind of intelligent function method for closing of intelligent glasses, described method comprises:
S410: blinkpunkt detecting step, detection user's blinkpunkt;
S420: be related to determining step, judge whether described blinkpunkt and an object meet a position relationship;
S430: time determining step, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches one the 3rd threshold value; And
S440: intelligent function is closed step, when meeting the duration of described position relationship while reaching described the 3rd threshold value, closes the described intelligent function of described intelligent glasses.
Below, 15-18 introduces each step function of above-mentioned intelligent function method for closing by reference to the accompanying drawings.
S410: blinkpunkt detecting step, detection user's blinkpunkt.
In an embodiment, as shown in figure 16, this blinkpunkt detecting step S410 can further comprise:
S411: scene is taken step, takes the scene image that user sees by described intelligent glasses;
S412: eyes are taken step, takes the image of eyes of user;
S413: direction of gaze determining step, determine the direction of gaze of eyes of user according to the described image of eyes of user; And
S414: blinkpunkt detecting step, determine described user's described blinkpunkt according to described scene image and described direction of gaze.
This scene is taken step S411 and can be utilized scene filming apparatus 311 to carry out, and takes in real time the scene image that user sees by this intelligent glasses to front, the user visual field.
These eyes are taken step S412 and can be utilized eyes filming apparatus 312 to carry out, and take in real time the image of eyes of user.This eye image can comprise the information such as pupil position.
This direction of gaze determining step S413 can utilize direction of gaze determining device 313 to carry out, and determines the direction of gaze of eyes of user according to captured eye image in eyes shooting step S412.Preferably, in the time that eye image comprises pupil position information, in this direction of gaze determining step S413, can directly determine according to this pupil position information the direction of gaze of eyes of user.
This blinkpunkt detecting step S414 can utilize blinkpunkt pick-up unit 314 to carry out, according to the blinkpunkt of taking scene image captured in step S411 in scene and determined direction of gaze can be determined user in direction of gaze determining step S413.
S420: be related to determining step, judge whether described blinkpunkt and an object meet a position relationship.
In the specific embodiment of the invention, this object can set in advance.Therefore preferably, in the intelligent function method for closing in the present invention, can further comprise that one sets in advance the step of this object.For the ease of this object is identified, can further comprise an object information storing step, will be pre-stored in a database for the relevant information of identifying this object.
In one embodiment of the present invention, this object can be that user observes a point of fixity or the fixed object in scene, now can choose the point of fixity carried out in intelligent function place scene or fixed object as this object.In another embodiment of the present invention, this object can be that user observes a motor point or the moving object in scene, now can choose the motor point of carrying out in intelligent function place scene or moving object as this object.
In the above in two kinds of embodiments, in the time that default object is a point (fixing or motion) or an object (fixing or motion), be related at this whether the distance that judges detected user's blinkpunkt and this object in determining step S420 is greater than one the 4th threshold value, meet the distance that described position relationship refers to user's blinkpunkt and this object and be greater than the 4th threshold value.This threshold value can be set according to the actual requirements by those skilled in the art.
Preferably, as shown in figure 17, this is related to that determining step S420 can further comprise scope determining step S421 and object determining step S422, wherein scope determining step S421 determines a scope that is not more than the 4th threshold value with this blinkpunkt distance, object determining step S422 judges whether this object appears within the scope of this, does not appear at the distance that can judge user's blinkpunkt and this object within the scope of this and is greater than the 4th threshold value when judging this object.
In another embodiment of the present invention, this object can be that user observes a fixed area or the moving region in scene, now can choose the fixed area carried out in intelligent function place scene or moving region as this object.
In the above-described embodiment, in the time that default object is a fixed area or moving region, this is related to that determining step S420 judges whether detected user's blinkpunkt exceeds the scope of this object, meets described position relationship and refers to that described user's described blinkpunkt exceeds the scope of described object.
Preferably, as shown in figure 18, this is related to that determining step S420 can further comprise object identification step S423 and blinkpunkt determining step S424, in the scene that wherein object identification step S423 sees user, identify this object, blinkpunkt determining step S424 judges whether user's blinkpunkt exceeds the scope of this object.
S430: time determining step, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches one the 3rd threshold value.
Particularly, in the time that default object is a point or an object, if be related to that at this distance of judging this user's blinkpunkt and this object in determining step S420 is greater than the 4th threshold value, in time determining step S430, start timing, this timing is greater than in duration of the 4th threshold value and carries out continuously in both distances, and judges at any time whether this duration reaches the 3rd threshold value; In the time that default object is a fixed area or moving region, if be related to and judge the scope that this user's blinkpunkt exceeds this object in determining step S420 at this, in time determining step S430, start timing, this timing is carried out continuously within this blinkpunkt exceeds duration of this object scope, and judges at any time whether this duration reaches the 3rd threshold value.The 3rd threshold value can be set according to the actual requirements by those skilled in the art.
S440: intelligent function is closed step, when meeting the duration of described position relationship while reaching described the 3rd threshold value, closes the described intelligent function of described intelligent glasses.
Particularly, in the time that default object is a point or an object, if judge duration that the distance of this user's blinkpunkt and this object is greater than the 4th threshold value while reaching the 3rd threshold value in this time determining step S430, close and in step S440, close corresponding intelligent function at intelligent function; In the time that default object is a fixed area or moving region, if judge duration that this user's blinkpunkt exceeds this object scope while reaching the 3rd threshold value in this time determining step S430, close and in step S440, close corresponding intelligent function at intelligent function.
According to another embodiment of the present invention, as shown in figure 19, provide a kind of intelligent function shutdown system 300 ' of intelligent glasses, described system 300 ' comprising:
Be related to judgment device 320, for judging whether described blinkpunkt and an object meet a position relationship; And
Intelligent function closing device 340 ', in the time that whether described blinkpunkt and described object meet described position relationship, closes the described intelligent function of described intelligent glasses.
The intelligent function shutdown system 300 of introducing before contrast is visible, and this intelligent function shutdown system 300 ' has been removed the time judgment device in intelligent function shutdown system 300 and adjusted the corresponding function of intelligent function closing device.In fact, this intelligent function shutdown system 300 ' is in intelligent function shutdown system 300, to be a kind of special case of 0 o'clock by the set of time of the 3rd threshold value, in system operational process, omit the judgement of the duration to meeting position relationship, once this blinkpunkt and this object meet this position relationship and just close corresponding intelligent function.
Corresponding, according to another embodiment of the present invention, as shown in figure 20, providing a kind of intelligent function method for closing of intelligent glasses, described method comprises:
S410: blinkpunkt detecting step, detection user's blinkpunkt;
S420: be related to determining step, judge whether described blinkpunkt and an object meet a position relationship; And
S440 ' intelligent function is closed step, in the time that whether described blinkpunkt and described object meet described position relationship, closes the described intelligent function of described intelligent glasses.
Before contrast, the intelligent function method for closing introduced is visible, and this method has been removed time determining step and adjusted intelligent function the corresponding function of closing step.In fact, the method is to be a kind of special case of 0 o'clock by the set of time of the 3rd threshold value in intelligent function method for closing before, in method implementation, omit the judgement of the duration to meeting position relationship, once this blinkpunkt and this object meet this position relationship and just close corresponding intelligent function.
In conjunction with several embodiment, the application of method and system of the present invention under concrete application scenarios described below.
embodiment 1
User adorns oneself with the intelligent glasses of the intelligent function open system 100 comprising in the specific embodiment of the invention, wish to start to write mathematical formulae and utilize this intelligent glasses to identify on a fixing blank, the position, the upper left corner of this fixing blank has been set to object and its identifying information has been stored in the database in intelligent glasses before this.
embodiment 2
User adorns oneself with the intelligent glasses of the intelligent function open system 100 comprising in the specific embodiment of the invention, wish to start to do area identification and utilize intelligent glasses to identify this region in scene with pointing forwardly, a finger ring of wearing on user's finger before this has been set to object and its identifying information has been stored in the database in intelligent glasses.
embodiment 3
User adorns oneself with the intelligent glasses of the intelligent function shutdown system 300 comprising in the specific embodiment of the invention, intelligent function ongoing, that obtain passage and translate on a panel computer before wishing to close.The screen area of this panel computer has been set to object and its identifying information has been stored in the database in intelligent glasses before this.
Visible by above-described embodiment, user only just can start or close the specific intelligent function of intelligent glasses by watching attentively of sight, the both hands of having liberated like this user, and operation is very easy, avoided intelligent function to realize the impact causing simultaneously.
Those of ordinary skill in the art can recognize, unit and the method step of each example of describing in conjunction with embodiment disclosed herein, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can realize described function with distinct methods to each specifically should being used for, but this realization should not thought and exceeds scope of the present invention.
If described function realizes and during as production marketing independently or use, can be stored in a computer read/write memory medium using the form of SFU software functional unit.Based on such understanding, the part that technical scheme of the present invention contributes to original technology in essence in other words or the part of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) carry out all or part of step of method described in each embodiment of the present invention.And aforesaid computer read/write memory medium comprises storing as any mode of the information such as computer-readable instruction, data structure, program module or other data or physics volatibility that technology realizes and non-volatile, removable and can not be because of eastern medium.Computer read/write memory medium specifically comprises, but be not limited to, USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), Erasable Programmable Read Only Memory EPROM (EPROM), EEPROM (Electrically Erasable Programmable Read Only Memo) (EEPROM), flash memory or other solid-state memory technology, CD-ROM, digital versatile disc (DVD), HD-DVD, blue light (Blue-Ray) or other light storage devices, tape, disk storage or other magnetic storage apparatus, maybe can be used for storing information needed and can be by any other medium of computer access.
Above embodiment is only for illustrating the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; without departing from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.
Claims (39)
1. an intelligent function starting method for intelligent glasses, is characterized in that, described method comprises:
Blinkpunkt detecting step, detection user's blinkpunkt;
Be related to determining step, judge whether described blinkpunkt and an object meet a position relationship;
Time determining step, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches a first threshold; And
Intelligent function setting up procedure, when meeting the duration of described position relationship while reaching described first threshold, starts the described intelligent function of described intelligent glasses.
2. method according to claim 1, is characterized in that, described blinkpunkt detecting step comprises:
Take the scene image that user sees by described intelligent glasses;
Take the image of eyes of user;
Determine the direction of gaze of eyes of user according to the described image of eyes of user;
Determine described user's described blinkpunkt according to described scene image and described direction of gaze.
3. method according to claim 2, is characterized in that, the pupil position in the described image based on eyes of user is determined the described direction of gaze of eyes of user.
4. method according to claim 1, is characterized in that,
Described object is a point of fixity or a fixed object.
5. method according to claim 1, is characterized in that,
Described object is a motor point or a moving object.
6. according to the method described in claim 4 or 5, it is characterized in that, be related in determining step described, judge whether described user's described blinkpunkt and the distance of described object are less than a Second Threshold.
7. method according to claim 6, is characterized in that, is describedly related to that determining step comprises:
Determine the scope that is less than described Second Threshold with described blinkpunkt distance;
Judge whether described object appears in described scope.
8. method according to claim 1, is characterized in that,
Described object is a fixed area or a moving region.
9. method according to claim 8, is characterized in that,
Be related in determining step described, judge whether described user's described blinkpunkt drops in the scope of described object.
10. method according to claim 9, is characterized in that, is describedly related to that determining step comprises:
Identify described object;
Whether the described blinkpunkt that judges described user drops in the scope of described object.
The intelligent function starting method of 11. 1 kinds of intelligent glasses, is characterized in that, described method comprises:
Blinkpunkt detecting step, detection user's blinkpunkt;
Be related to determining step, judge whether described blinkpunkt and an object meet a position relationship; And
Intelligent function setting up procedure, in the time that described blinkpunkt and described object meet described position relationship, starts the described intelligent function of described intelligent glasses.
The intelligent function of 12. 1 kinds of intelligent glasses starts system, it is characterized in that, described system comprises:
One blinkpunkt checkout equipment, for detection of a user blinkpunkt;
One is related to judgment device, for judging whether described blinkpunkt and an object meet a position relationship;
One time judgment device, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches a first threshold; And
One intelligent function starting outfit, for when meeting the duration of described position relationship while reaching described first threshold, starts the described intelligent function of described intelligent glasses.
13. systems according to claim 12, is characterized in that, described blinkpunkt checkout equipment comprises:
One scene filming apparatus, the scene image of seeing by described intelligent glasses for taking user;
One eyes filming apparatus, for taking the image of eyes of user;
One direction of gaze determining device, for determining the direction of gaze of eyes of user according to the described image of eyes of user;
One blinkpunkt pick-up unit, for determining described user's described blinkpunkt according to described scene image and described direction of gaze.
14. systems according to claim 13, is characterized in that, the pupil position in the described image of described direction of gaze determining device based on eyes of user is determined the described direction of gaze of eyes of user.
15. systems according to claim 12, is characterized in that, are describedly related to that judgment device is specifically for judging whether described user's described blinkpunkt and the distance of described object are less than a Second Threshold.
16. systems according to claim 15, is characterized in that, are describedly related to that judgment device further comprises:
One scope determining device, for determining the scope that is less than described Second Threshold with described blinkpunkt distance;
One object judgment means, for judging whether described object appears at described scope.
17. systems according to claim 12, is characterized in that,
Describedly be related to whether judgment device drops in the scope of described object specifically for the described blinkpunkt that judges described user.
18. systems according to claim 17, is characterized in that, are describedly related to that judgment device further comprises:
One object recognition device, for identifying described object;
Whether one blinkpunkt judgment means, drop in the scope of described object for the described blinkpunkt that judges described user.
The intelligent function of 19. 1 kinds of intelligent glasses starts system, it is characterized in that, described system comprises:
One blinkpunkt checkout equipment, for detection of a user blinkpunkt;
One is related to judgment device, for judging whether described blinkpunkt and an object meet a position relationship; And
One intelligent function starting outfit, in the time that described blinkpunkt and described object meet described position relationship, starts the described intelligent function of described intelligent glasses.
The intelligent function method for closing of 20. 1 kinds of intelligent glasses, is characterized in that, described method comprises:
Blinkpunkt detecting step, detection user's blinkpunkt;
Be related to determining step, judge whether described blinkpunkt and an object meet a position relationship;
Time determining step, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches one the 3rd threshold value; And
Intelligent function is closed step, when meeting the duration of described position relationship while reaching described the 3rd threshold value, closes the described intelligent function of described intelligent glasses.
21. methods according to claim 20, is characterized in that, described blinkpunkt detecting step comprises:
Take the scene image that user sees by described intelligent glasses;
Take the image of eyes of user;
Determine the direction of gaze of eyes of user according to the described image of eyes of user;
Determine described user's described blinkpunkt according to described scene image and described direction of gaze.
22. methods according to claim 21, is characterized in that, the pupil position in the described image based on eyes of user is determined the described direction of gaze of eyes of user.
23. methods according to claim 20, is characterized in that,
Described object is a point of fixity or a fixed object.
24. methods according to claim 20, is characterized in that,
Described object is a motor point or a moving object.
25. according to the method described in claim 23 or 24, it is characterized in that, is related in determining step described, judges whether described user's described blinkpunkt and the distance of described object are greater than one the 4th threshold value.
26. methods according to claim 25, is characterized in that, are describedly related to that determining step comprises:
Determine the scope that is not less than described the 4th threshold value with described blinkpunkt distance;
Judge whether described object appears in described scope.
27. methods according to claim 20, is characterized in that,
Described object is a fixed area or a moving region.
28. methods according to claim 27, is characterized in that,
Be related in determining step described, judge whether described user's described blinkpunkt drops in the scope of described object.
29. methods according to claim 28, is characterized in that, are describedly related to that determining step comprises:
Identify described object;
Whether the described blinkpunkt that judges described user drops in the scope of described object.
The intelligent function method for closing of 30. 1 kinds of intelligent glasses, is characterized in that, described method comprises:
Blinkpunkt detecting step, detection user's blinkpunkt;
Be related to determining step, judge whether described blinkpunkt and an object meet a position relationship; And
Intelligent function is closed step, in the time that described blinkpunkt and described object meet described position relationship, closes the described intelligent function of described intelligent glasses.
The intelligent function shutdown system of 31. 1 kinds of intelligent glasses, is characterized in that, described system comprises:
One blinkpunkt checkout equipment, for detection of a user blinkpunkt;
One is related to judgment device, for judging whether described blinkpunkt and an object meet a position relationship;
One time judgment device, in the time that described blinkpunkt and described object meet described position relationship, whether the duration that judgement meets described position relationship reaches one the 3rd threshold value; And
One intelligent function closing device, for when meeting the duration of described position relationship while reaching described the 3rd threshold value, closes the described intelligent function of described intelligent glasses.
32. systems according to claim 31, is characterized in that, described blinkpunkt checkout equipment comprises:
One scene filming apparatus, the scene image of seeing by described intelligent glasses for taking user;
One eyes filming apparatus, for taking the image of eyes of user;
One direction of gaze determining device, for determining the direction of gaze of eyes of user according to the described image of eyes of user;
One blinkpunkt pick-up unit, for determining described user's described blinkpunkt according to described scene image and described direction of gaze.
33. systems according to claim 32, is characterized in that, the pupil position in the described image of described direction of gaze determining device based on eyes of user is determined the described direction of gaze of eyes of user.
34. systems according to claim 31, is characterized in that, are describedly related to that judgment device is specifically for judging whether described user's described blinkpunkt and the distance of described object are greater than one the 4th threshold value.
35. systems according to claim 34, is characterized in that, are describedly related to that judgment device further comprises:
One scope determining device, for determining the scope that is not less than described the 4th threshold value with described blinkpunkt distance;
One object judgment means, for judging whether described object appears at described scope.
36. systems according to claim 31, is characterized in that,
Describedly be related to whether judgment device drops in the scope of described object specifically for the described blinkpunkt that judges described user.
37. systems according to claim 36, is characterized in that, are describedly related to that judgment device further comprises:
One object recognition device, for identifying described object;
Whether one blinkpunkt judgment means, drop in the scope of described object for the described blinkpunkt that judges described user.
The intelligent function shutdown system of 38. 1 kinds of intelligent glasses, is characterized in that, described system comprises:
One blinkpunkt checkout equipment, for detection of a user blinkpunkt;
One is related to judgment device, for judging whether described blinkpunkt and an object meet a position relationship; And
One intelligent function closing device, in the time that described blinkpunkt and described object meet described position relationship, closes the described intelligent function of described intelligent glasses.
39. 1 kinds of intelligent glasses, is characterized in that, comprise the system described in any one in claim 12,19,31,38.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310597866.0A CN103838372A (en) | 2013-11-22 | 2013-11-22 | Intelligent function start/stop method and system for intelligent glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310597866.0A CN103838372A (en) | 2013-11-22 | 2013-11-22 | Intelligent function start/stop method and system for intelligent glasses |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103838372A true CN103838372A (en) | 2014-06-04 |
Family
ID=50801966
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310597866.0A Pending CN103838372A (en) | 2013-11-22 | 2013-11-22 | Intelligent function start/stop method and system for intelligent glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103838372A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156138A (en) * | 2014-07-31 | 2014-11-19 | 北京智谷睿拓技术服务有限公司 | Shooting controlling method and device |
| CN104866100A (en) * | 2015-05-27 | 2015-08-26 | 京东方科技集团股份有限公司 | Eye-controlled device, eye-controlled method and eye-controlled system |
| CN105138118A (en) * | 2015-07-31 | 2015-12-09 | 努比亚技术有限公司 | Intelligent glasses, method and mobile terminal for implementing human-computer interaction |
| CN105824419A (en) * | 2016-03-18 | 2016-08-03 | 苏州佳世达电通有限公司 | Wearing device interaction system and wearing device interaction method |
| CN106227345A (en) * | 2016-07-21 | 2016-12-14 | 深圳市金立通信设备有限公司 | A kind of virtual reality glasses and control method thereof |
| CN106888350A (en) * | 2015-12-15 | 2017-06-23 | 北京奇虎科技有限公司 | Processing method of taking pictures, intelligent glasses and user terminal based on intelligent glasses |
| WO2018086223A1 (en) * | 2016-11-08 | 2018-05-17 | 歌尔科技有限公司 | Vr head-mounted apparatus, and control method of vr head-mounted apparatus |
| CN108337430A (en) * | 2018-02-07 | 2018-07-27 | 北京联合大学 | 360 degree without dead angle intelligent glasses |
| CN108491072A (en) * | 2018-03-05 | 2018-09-04 | 京东方科技集团股份有限公司 | A kind of virtual reality exchange method and device |
| CN109725719A (en) * | 2018-12-28 | 2019-05-07 | 歌尔科技有限公司 | Apparatus control method, device and electronic equipment, storage medium |
| CN111274870A (en) * | 2020-01-07 | 2020-06-12 | 北京小米移动软件有限公司 | Intelligent glasses control method, intelligent glasses control device and storage medium |
| CN111630435A (en) * | 2017-12-15 | 2020-09-04 | 奇跃公司 | Enhanced gesture determination for display devices |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102163377A (en) * | 2010-02-24 | 2011-08-24 | 英特尔公司 | Facial tracking electronic reader |
| CN102749990A (en) * | 2011-04-08 | 2012-10-24 | 索尼电脑娱乐公司 | Systems and methods for providing feedback by tracking user gaze and gestures |
| CN102822771A (en) * | 2010-01-21 | 2012-12-12 | 托比技术股份公司 | Eye tracker based contextual action |
| CN103246350A (en) * | 2013-05-14 | 2013-08-14 | 中国人民解放军海军航空工程学院 | Man-machine interface device and method for achieving auxiliary information prompting based on regions of interest |
| CN103294178A (en) * | 2012-02-29 | 2013-09-11 | 联想(北京)有限公司 | Man-machine interaction control method and electronic terminal |
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
-
2013
- 2013-11-22 CN CN201310597866.0A patent/CN103838372A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102822771A (en) * | 2010-01-21 | 2012-12-12 | 托比技术股份公司 | Eye tracker based contextual action |
| CN102163377A (en) * | 2010-02-24 | 2011-08-24 | 英特尔公司 | Facial tracking electronic reader |
| CN102749990A (en) * | 2011-04-08 | 2012-10-24 | 索尼电脑娱乐公司 | Systems and methods for providing feedback by tracking user gaze and gestures |
| CN103294178A (en) * | 2012-02-29 | 2013-09-11 | 联想(北京)有限公司 | Man-machine interaction control method and electronic terminal |
| CN103246350A (en) * | 2013-05-14 | 2013-08-14 | 中国人民解放军海军航空工程学院 | Man-machine interface device and method for achieving auxiliary information prompting based on regions of interest |
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104156138A (en) * | 2014-07-31 | 2014-11-19 | 北京智谷睿拓技术服务有限公司 | Shooting controlling method and device |
| CN104156138B (en) * | 2014-07-31 | 2017-08-22 | 北京智谷睿拓技术服务有限公司 | Filming control method and imaging control device |
| CN104866100A (en) * | 2015-05-27 | 2015-08-26 | 京东方科技集团股份有限公司 | Eye-controlled device, eye-controlled method and eye-controlled system |
| US10372206B2 (en) | 2015-05-27 | 2019-08-06 | Boe Technology Group Co., Ltd. | Eye-controlled apparatus, eye-controlled method and eye-controlled system |
| WO2016188258A1 (en) * | 2015-05-27 | 2016-12-01 | 京东方科技集团股份有限公司 | Eye-controlled apparatus, eye-controlled method and eye-controlled system |
| CN104866100B (en) * | 2015-05-27 | 2018-11-23 | 京东方科技集团股份有限公司 | Eye control device and its eye prosecutor method and eye control system |
| CN105138118A (en) * | 2015-07-31 | 2015-12-09 | 努比亚技术有限公司 | Intelligent glasses, method and mobile terminal for implementing human-computer interaction |
| CN106888350A (en) * | 2015-12-15 | 2017-06-23 | 北京奇虎科技有限公司 | Processing method of taking pictures, intelligent glasses and user terminal based on intelligent glasses |
| CN105824419A (en) * | 2016-03-18 | 2016-08-03 | 苏州佳世达电通有限公司 | Wearing device interaction system and wearing device interaction method |
| CN105824419B (en) * | 2016-03-18 | 2018-12-11 | 苏州佳世达电通有限公司 | Object wearing device interactive system and object wearing device exchange method |
| CN106227345A (en) * | 2016-07-21 | 2016-12-14 | 深圳市金立通信设备有限公司 | A kind of virtual reality glasses and control method thereof |
| WO2018086223A1 (en) * | 2016-11-08 | 2018-05-17 | 歌尔科技有限公司 | Vr head-mounted apparatus, and control method of vr head-mounted apparatus |
| US11112848B2 (en) | 2016-11-08 | 2021-09-07 | Goertek Technology Co., Ltd | VR headset with pressure sensor and distance sensor and method for controlling VR headset |
| CN111630435A (en) * | 2017-12-15 | 2020-09-04 | 奇跃公司 | Enhanced gesture determination for display devices |
| CN108337430A (en) * | 2018-02-07 | 2018-07-27 | 北京联合大学 | 360 degree without dead angle intelligent glasses |
| CN108491072A (en) * | 2018-03-05 | 2018-09-04 | 京东方科技集团股份有限公司 | A kind of virtual reality exchange method and device |
| CN108491072B (en) * | 2018-03-05 | 2020-01-21 | 京东方科技集团股份有限公司 | Virtual reality interaction method and device |
| WO2019169834A1 (en) * | 2018-03-05 | 2019-09-12 | Boe Technology Group Co., Ltd. | Virtual reality interaction method, virtual reality interaction apparatus, virtual reality display apparatus, and computer-program product |
| US11301037B2 (en) | 2018-03-05 | 2022-04-12 | Beijing Boe Optoelectronics Technology Co., Ltd. | Virtual reality interaction method, virtual reality interaction apparatus, virtual reality display apparatus, and computer-program product |
| CN109725719A (en) * | 2018-12-28 | 2019-05-07 | 歌尔科技有限公司 | Apparatus control method, device and electronic equipment, storage medium |
| CN111274870A (en) * | 2020-01-07 | 2020-06-12 | 北京小米移动软件有限公司 | Intelligent glasses control method, intelligent glasses control device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103838372A (en) | Intelligent function start/stop method and system for intelligent glasses | |
| US11995774B2 (en) | Augmented reality experiences using speech and text captions | |
| US11093045B2 (en) | Systems and methods to augment user interaction with the environment outside of a vehicle | |
| US9583032B2 (en) | Navigating content using a physical object | |
| Song et al. | In-air gestures around unmodified mobile devices | |
| CN109729426B (en) | Method and device for generating video cover image | |
| US20190025936A1 (en) | Systems and methods for extensions to alternative control of touch-based devices | |
| US9329678B2 (en) | Augmented reality overlay for control devices | |
| CN115280262A (en) | Device, method and graphical user interface for providing a computer-generated experience | |
| US20180011534A1 (en) | Context-aware augmented reality object commands | |
| CN107479691B (en) | Interaction method, intelligent glasses and storage device thereof | |
| CN111580652B (en) | Video playing control method and device, augmented reality equipment and storage medium | |
| CN110546601B (en) | Information processing device, information processing method, and program | |
| CA3036208A1 (en) | Sensory eyewear | |
| WO2013032241A1 (en) | Schedule managing method and apparatus using optical character reader | |
| KR101647969B1 (en) | Apparatus for detecting user gaze point, and method thereof | |
| KR20140002007A (en) | Information processing device, information processing method, and recording medium | |
| CN112585566A (en) | Hand-covering face input sensing for interacting with device having built-in camera | |
| US20150235346A1 (en) | Display apparatus and control method thereof | |
| TW200844809A (en) | Display apparatus | |
| US20220221970A1 (en) | User interface modification | |
| CN115857856A (en) | Information prompting method, information prompting device, electronic equipment and readable storage medium | |
| US20190114131A1 (en) | Context based operation execution | |
| EP3137968B1 (en) | Gaze detector using reference frames in media | |
| CN110291495B (en) | Information processing system, information processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140604 |