CN107065622A - A kind of electric operation information feedback method and device - Google Patents
A kind of electric operation information feedback method and device Download PDFInfo
- Publication number
- CN107065622A CN107065622A CN201710379248.7A CN201710379248A CN107065622A CN 107065622 A CN107065622 A CN 107065622A CN 201710379248 A CN201710379248 A CN 201710379248A CN 107065622 A CN107065622 A CN 107065622A
- Authority
- CN
- China
- Prior art keywords
- distance
- user
- image
- unit
- mrow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000012545 processing Methods 0.000 claims abstract description 28
- 230000001815 facial effect Effects 0.000 claims description 35
- 230000004044 response Effects 0.000 claims description 10
- 230000000875 corresponding effect Effects 0.000 description 17
- 230000008569 process Effects 0.000 description 16
- 238000013459 approach Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- YCKRFDGAMUMZLT-UHFFFAOYSA-N Fluorine atom Chemical compound [F] YCKRFDGAMUMZLT-UHFFFAOYSA-N 0.000 description 3
- 230000009471 action Effects 0.000 description 3
- 210000004709 eyebrow Anatomy 0.000 description 3
- 229910052731 fluorine Inorganic materials 0.000 description 3
- 239000011737 fluorine Substances 0.000 description 3
- 210000001015 abdomen Anatomy 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 230000005059 dormancy Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000007958 sleep Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004870 electrical engineering Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
Abstract
The invention provides a kind of electric operation information feedback method and device, this method includes：Obtain the operation information of an electrical equipment；First image of the collection including triggering user in default pickup area；The first distance between the triggering user and the electrical equipment is determined according to described first image；Judge first distance whether in the range of default first distance threshold；If it is, being reported by the form of voice broadcast to the operation information.The device includes：Acquiring unit, collecting unit, processing unit, judging unit and report unit.The operation information of household electrical appliance can be fed back to user by this programme in time.
Description
Technical Field
The invention relates to the technical field of electrical engineering, in particular to an electric appliance operation information feedback method and device.
Background
With the continuous improvement of living standard, various household appliances become essential products for families, and bring great convenience to the life of users, such as air conditioners, refrigerators, washing machines and the like. Along with the development and progress of the internet of things technology, household appliances are also developed towards intellectualization. Various types of sensors are integrated in the household appliance, the running information of the household appliance is detected through the sensors, and the running information of the detected household appliance is fed back to a user, so that the user can know the running state of the household appliance.
At present, after a sensor in a home appliance detects operation information of the home appliance, the detected operation information is sent to an appliance management APP (mobile application) of a user directly or through a server connected to the home appliance.
According to the method for feeding back the running information of the household appliance at present, after the running information of the household appliance is sent to an appliance management APP, a user can obtain the running information of the household appliance only after the appliance management APP runs. The appliance management APP generally cannot be in an operating state all the time, so that the operating information of the household appliance cannot be fed back to the user in time.
Disclosure of Invention
The embodiment of the invention provides an electric appliance operation information feedback method and device, which can feed back the operation information of a household electric appliance to a user in time.
In a first aspect, an embodiment of the present invention provides an electrical appliance operation information feedback method, including:
acquiring operation information of an electric appliance;
acquiring a first image including a trigger user in a preset acquisition area;
determining a first distance between the triggering user and the appliance according to the first image;
judging whether the first distance is within a preset first distance threshold range;
if so, broadcasting the operation information in a voice broadcasting mode.
Optionally, the determining a first distance between the triggering user and the appliance from the first image comprises:
identifying at least two keypoints of the triggering user from the first image;
calculating a first distance between the trigger user and the electric appliance according to the distance between the at least two key points on the first image and a predetermined standard distance between the at least two key points by a first formula;
the first formula comprises:
wherein H represents the first distance, n represents the number of the key points, k represents a constant, and X representsiCharacterizing a criterion distance between an ith pair of the keypoints, the xiCharacterizing a distance between an ith pair of the keypoints of the first image row.
Optionally, the determining a first distance between the triggering user and the appliance from the first image comprises:
identifying an image of the triggering user from the first image;
determining a pixel ratio of pixels occupied by the image of the trigger user to total pixels of the first image;
according to the pixel ratio, calculating a first distance between the trigger user and the electric appliance through a formula II;
the second formula includes:
H＝K·m
wherein H characterizes the first distance, K characterizes a constant, and m characterizes the pixel ratio.
Alternatively,
pre-storing facial images and identity information of at least one user of the appliance;
before the form through the voice broadcast is to the operation information is broadcasted, further include:
identifying a facial image of the triggering user from the first image;
matching the facial image of the trigger user with the facial image of the at least one user, and determining the identity information of the trigger user according to the corresponding relation between the facial image of the at least one user and the identity information;
and broadcasting greeting information corresponding to the identity information of the trigger user in a voice broadcasting mode.
Optionally, after the determining whether the first distance is within a preset first distance threshold range, the method further includes:
if the first distance is out of the first distance threshold range, judging whether the first distance is in a preset second distance threshold range, wherein the maximum value of the second distance threshold range is smaller than the minimum value of the first distance threshold range;
if so, lightening the display screen of the electric appliance, enabling the display screen of the electric appliance to display a user operation interface, and sending out prompt information that the electric appliance enters an operation waiting state in a voice broadcasting mode.
Optionally, after determining that the first distance is within the second distance threshold range, the method further includes:
acquiring a second image including the trigger user within the acquisition area;
determining a second distance between the triggering user and the appliance according to the second image;
judging whether the second distance is out of the second distance threshold range;
if yes, the display screen of the electric appliance is turned off, and prompt information that the electric appliance is in the operation dormant state is sent out in a voice broadcasting mode.
In a second aspect, an embodiment of the present invention further provides an apparatus for feeding back operation information of an electrical appliance, including: the device comprises an acquisition unit, a collection unit, a processing unit, a judgment unit and a broadcast unit;
the acquisition unit is used for acquiring the operation information of an electric appliance;
the acquisition unit is used for acquiring a first image including a trigger user in a preset acquisition area;
the processing unit is used for determining a first distance between the trigger user and the electric appliance according to the first image acquired by the acquisition unit;
the judging unit is used for judging whether the first distance determined by the processing unit is within a preset first distance threshold range or not;
and the broadcasting unit is used for broadcasting the operation information acquired by the acquiring unit in a voice broadcasting mode according to the judgment result of the judging unit if the operation information is acquired by the judging unit.
Alternatively,
the processing unit includes: a first identifying subunit and a first calculating subunit;
the first identification subunit is configured to identify at least two key points of the trigger user from the first image;
the first calculating subunit is configured to calculate, according to the distance between the at least two key points identified by the first identifying subunit on the first image and a predetermined standard distance between the at least two key points, a first distance between the trigger user and the electrical appliance according to a first formula;
the first formula comprises:
wherein H represents the first distance, n represents the number of the key points, k represents a constant, and X representsiCharacterizing a criterion distance between an ith pair of the keypoints, the xiCharacterizing a distance between an ith pair of the keypoints of the first image row.
Alternatively,
the processing unit includes: a second identifying subunit and a second calculating subunit;
the second identifying subunit is configured to identify the image of the trigger user from the first image;
the second calculating subunit is configured to determine a pixel ratio of pixels occupied by the image of the trigger user identified by the second identifying subunit to total pixels of the first image, and calculate a first distance between the trigger user and the electrical appliance according to the pixel ratio by using a second formula;
the second formula includes:
H＝K·m
wherein H characterizes the first distance, K characterizes a constant, and m characterizes the pixel ratio.
Optionally, the apparatus further comprises: a pre-storing unit;
the pre-storage unit is used for pre-storing the facial image and the identity information of at least one user of the electric appliance;
the processing unit is further configured to, before the broadcasting unit broadcasts the operation information acquired by the acquisition unit in a voice broadcasting manner, identify a facial image of the trigger user from the first image, compare the facial image of the trigger user with the facial image of the at least one user, and determine the identity information of the trigger user according to a correspondence between the facial image of the at least one user and the identity information, which is prestored by the prestoring unit;
the broadcasting unit is further used for broadcasting greeting information corresponding to the identity information of the triggering user determined by the processing unit in a voice broadcasting mode.
Optionally, the apparatus further comprises: a response unit;
the determining unit is further configured to determine whether the first distance is within a preset second distance threshold range after determining that the first distance is outside the first distance threshold range, where a maximum value of the second distance threshold range is smaller than a minimum value of the first distance threshold range;
the response unit is used for lightening a display screen of the electrical appliance to enable the display screen of the electrical appliance to display a user operation interface if the first distance is within the second distance threshold range according to the judgment result of the judgment unit;
and the broadcast unit is further used for sending a prompt message that the electric appliance has entered an operation waiting state in a voice broadcast mode according to the judgment result of the judgment unit and if the first distance is within the second distance threshold range.
Alternatively,
the acquisition unit is further used for acquiring a second image comprising the trigger user in the acquisition area after the judgment unit judges that the first distance is within the second distance threshold range;
the processing unit is further used for determining a second distance between the trigger user and the electric appliance according to the second image acquired by the acquisition unit;
the judging unit is further used for judging whether the second distance determined by the processing unit is out of the second distance threshold range;
the response unit is further used for turning off the display screen of the electrical appliance according to the judgment result of the judgment unit if the second distance is out of the second distance threshold range;
and the broadcast unit is further used for sending a prompt message that the electric appliance enters the operation dormant state in a voice broadcast mode according to the judgment result of the judgment unit and if the second distance is out of the second distance threshold range.
The embodiment of the invention provides an electric appliance operation information feedback method and device, after operation information of an electric appliance is acquired, when a trigger user enters a preset acquisition area, a first image comprising the trigger user is acquired, a first distance between the trigger user and the electric appliance is determined according to the first image, and when the first distance is within a preset first distance threshold range, the acquired operation information is broadcasted in a voice broadcast mode. Therefore, after a trigger user enters the acquisition area, a first distance between the trigger user and the electric appliance is determined by acquiring a first image comprising the trigger user, when the first distance meets a preset first distance threshold range, the distance between the trigger user and the electric appliance is indicated to enable the trigger user to hear the voice playing information, and at the moment, the running information of the electric appliance is sent to the trigger user in a voice broadcasting mode. Therefore, the user can automatically broadcast the operation information of the electric appliance by voice after the user approaches the electric appliance for a certain distance, so that the operation information of the electric appliance can be timely fed back to the user.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of an appliance operation information feedback method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of determining a first distance provided by one embodiment of the present invention;
FIG. 3 is a flow chart of another method for determining a first distance provided by one embodiment of the present invention;
fig. 4 is a flowchart of another method for feeding back operation information of an electrical appliance according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an appliance operation information feedback device according to an embodiment of the present invention;
fig. 6 is a schematic diagram of another device for feeding back operation information of an electric appliance according to an embodiment of the present invention;
fig. 7 is a schematic diagram of another device for feeding back operation information of an electric appliance according to an embodiment of the present invention;
fig. 8 is a schematic diagram of an appliance operation information feedback device including a pre-storage unit according to an embodiment of the present invention;
fig. 9 is a schematic diagram of an appliance operation information feedback device including a response unit according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer and more complete, the technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention, and based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts belong to the scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a method for feeding back information of a periodic operation, where the method may include the following steps:
step 101: acquiring operation information of an electric appliance;
step 102: acquiring a first image including a trigger user in a preset acquisition area;
step 103: determining a first distance between the triggering user and the appliance according to the first image;
step 104: judging whether the first distance is within a preset first distance threshold range, if so, executing the step 105, otherwise, ending the current process;
step 105: and broadcasting the operation information in a voice broadcasting mode.
The embodiment of the invention provides an electric appliance operation information feedback method, which comprises the steps of acquiring operation information of an electric appliance, acquiring a first image including a trigger user when the trigger user enters a preset acquisition area, determining a first distance between the trigger user and the electric appliance according to the first image, and broadcasting the acquired operation information in a voice broadcast mode when the first distance is within a preset first distance threshold range. Therefore, after a trigger user enters the acquisition area, a first distance between the trigger user and the electric appliance is determined by acquiring a first image comprising the trigger user, when the first distance meets a preset first distance threshold range, the distance between the trigger user and the electric appliance is indicated to enable the trigger user to hear the voice playing information, and at the moment, the running information of the electric appliance is sent to the trigger user in a voice broadcasting mode. Therefore, the user can automatically broadcast the operation information of the electric appliance by voice after the user approaches the electric appliance for a certain distance, so that the operation information of the electric appliance can be timely fed back to the user.
Optionally, the process of determining the first distance between the trigger user and the appliance according to the first image in step 103 may be implemented in two ways:
the first method is as follows: determining the first distance according to the ratio of the distance between at least two key points in the first image to the standard distance between the at least two key points;
the second method comprises the following steps: the first distance is determined according to a proportion of pixels of the first image that are triggering the user.
The above two ways of determining the first distance are described below with reference to specific examples.
For the manner of determining the first distance provided by the first manner, as shown in fig. 2, the following steps may be included:
step 201: at least two keypoints triggering the user are identified from the acquired first image.
Such as identifying as keypoints two shoulders and two eyebrows that trigger the user.
Step 202: the distance between any two keypoints on the first image is determined.
Such as determining the distance x between the left and right shoulders of the triggering user on the first image1Distance x between left shoulder and left eyebrow center2Distance x between left shoulder and right eyebrow center3Distance x between right shoulder and left eyebrow center4Distance x between right shoulder and right eyebrow center5And the distance x between the left and right eyebrow centers6。
Step 203: a predetermined criterion distance between at least two keypoints is obtained.
For example, the standard distance X between the left and right shoulders in actual situation is obtained1Standard distance X between left shoulder and left eyebrow center2The standard distance X between the left shoulder and the right eyebrow center3The standard distance X between the right shoulder and the left eyebrow center4Right shoulder and right brow center5And the standard distance X between the left and right eyebrow centers6. The standard distance between the key points can be obtained through big data analysis, for example, the big data analysis is performed on the distances between the left shoulder, the right shoulder, the left eyebrow center and the right eyebrow center of a large number of samples, so as to obtain the standard distance between any two of the left shoulder, the right shoulder, the left eyebrow center and the right eyebrow center.
Step 204: and calculating the first distance through a first formula according to the distance between the key points on the first image and the standard distance between the key points.
For example, x is determined in step 2021To x6And X determined in step 2031To X6Correspondingly substituting the formula I to calculate the first distance H, wherein the specific calculation process is as follows:
wherein H represents the first distance, n represents the number of the key points, k represents a constant, and X representsiCharacterizing a criterion distance between an ith pair of the keypoints, the xiCharacterizing a distance between an ith pair of the keypoints of the first image row.
Because the size of the object image and the distance between the object and the image acquisition equipment are in positive correlation, when the image acquisition equipment is integrated on an electric appliance, the distance between the user and the electric appliance can be calculated and triggered through the first formula.
It should be noted that, when determining the distance between at least two keypoints on the first image, the distance between some keypoints on the first image may be determined, for example, only the distance between the left shoulder and the right shoulder and the distance between the left eyebrow center and the right eyebrow center are determined. The number and the combination mode of the specific key points can be flexibly determined according to the requirements of actual service realization.
For the manner of determining the first distance provided by the second manner, as shown in fig. 3, the following steps may be included:
step 301: an image that triggers the user is identified from the first image.
For example, the first image includes an image above the abdomen of the user, and the image above the abdomen of the user is identified from the first image by a corresponding image identification method.
Step 302: a pixel ratio of pixels occupied by the image triggering the user to total pixels of the first image is determined.
For example, after the image of the triggering user is identified from the first image, the pixel occupied by the image of the triggering user is determined to be Y, and the total pixel of the first image is Y, wherein Y is larger than or equal to Y. And calculating the ratio of Y to Y as the pixel ratio m.
Step 303: and calculating the first distance by a formula two according to the pixel ratio.
For example, substituting the pixel ratio m calculated in step 302 into formula two, calculate a first distance H between the trigger user and the electrical appliance, and the specific calculation process is as follows:
wherein H characterizes the first distance, K characterizes a constant, and m characterizes the pixel ratio.
Since the area occupied by the object in the image is positively correlated with the distance of the object from the imaging device, the area occupied by the object in the image is directly represented by the pixels occupied by the object image. Thus, by providing the imaging device to the appliance, the distance between the triggering user and the appliance can be measured according to the pixel ratio of the triggering user image to the first image.
Optionally, for an electrical appliance, a facial image of at least one user of the electrical appliance is acquired in advance, identity information of each user is acquired respectively, and the facial image of each user and the identity information are stored correspondingly. The identity information of the user comprises the name, the mobile phone number and other information of the user. Before broadcasting the operation information of the electric appliance in a voice mode in step 105, the facial image of the trigger user is identified from the first image, the facial image of the trigger user is matched with the stored facial images of the users, the facial image of one user successfully matched with the facial image of the trigger user is determined, and then the identity information of the trigger user is determined according to the identity information stored corresponding to the facial image of the user. Before the operation information of the electric appliance is voice broadcast in step 105, greeting information corresponding to the identity information of the triggering user is voice broadcast.
For example, for an appliance, the appliance has 4 users, user 1 to user 4. The method comprises the steps of collecting and storing face images and identity information of 4 users, wherein the face images and the identity information of the user 1 are respectively a face image 1 and a name 1, the face images and the identity information of the user 2 are respectively a face image 2 and a name 2, the face images and the identity information of the user 3 are respectively a face image 3 and a name 3, and the face images and the identity information of the user 4 are respectively a face image 4 and a name 4. After the first distance is determined to be within the first distance threshold range, the face image of the trigger user is identified from the first image, the face image of the trigger user is matched with 4 face images stored in advance, for example, the face image 2 in the 4 face images is successfully matched with the face image of the trigger user, and the name 2 corresponding to the face image 2 is determined as the name of the trigger user. The greeting information corresponding to name 2 is played in the form of voice broadcast, and then the operation information of the appliance is voice broadcast, such as voice broadcast "Mr. 2 user, you! Air conditioning seems to leak fluorine, you treat it immediately ".
Before the operation information of the electric appliance is broadcasted to the trigger user through voice, the voice broadcast corresponds to the greeting information of the identity information of the trigger user, the feeling of the trigger user that the electric appliance can know the user is given, the intelligence degree and the technological feeling of the electric appliance are improved, and the use experience of the user is improved.
Optionally, after determining that the first distance is not within the first distance threshold range in step 104, it may be further determined whether the first distance is within a preset second distance threshold range, where a maximum value of the second distance threshold range is smaller than a minimum value of the first distance threshold, for example, the preset first distance threshold range is [2m, 5m ], and the threshold second distance threshold range is [0, 0.5m ]. After the first distance is judged to be within the range of the second distance threshold, a display screen of the electric appliance is lightened, so that the display screen of the electric appliance displays a user operation interface, and prompt information that the electric appliance enters an operation waiting state is sent out in a voice broadcast mode, for example, voice Boba 'you good, and a small Q (nickname of the electric appliance to itself) serves you'.
And when the distance between the trigger user and the electric appliance is within the second distance threshold range, the trigger user is positioned at the accessory of the electric appliance and possibly needs to operate the electric appliance, and at the moment, a display screen of the electric appliance is lightened to display a user operation interface, and prompt information that the electric appliance enters an operation waiting state is played in a voice mode. Like this, when the user is being close to the electrical apparatus, the display screen of electrical apparatus shows user operation interface and voice broadcast electrical apparatus and has got into the prompt message of operation wait state, gives the anthropomorphic state that user a wait user carries out the operation, has further promoted the intelligence and the science and technology sense of electrical apparatus, improves user's use and experiences.
Optionally, after the display screen of the electrical appliance is lit when the first distance between the trigger user and the electrical appliance is within the second distance threshold range, a second image including the trigger user is collected in the collection area, the second distance between the trigger user and the electrical appliance is determined according to the second image, whether the second distance is outside the second distance threshold range is judged, if yes, the display screen of the electrical appliance is turned off, and a prompt message that the electrical appliance has entered the operation sleep state is sent in a voice broadcast mode, such as voice broadcast "goodbye".
And when the user approaches the electric appliance, the display screen is lightened for the user to operate the electric appliance. After the user is far away from the electric appliance, the distance between the user and the electric appliance is not within the range of the second distance threshold value, the fact that the user operates the electric appliance is completed is indicated, the display screen of the electric appliance is turned off at the moment, the voice broadcast electric appliance enters the operation dormancy state prompt message, the user feels anthropomorphic, the technological sense of the electric appliance is improved, and the use experience of the user is further improved. Besides, after the user is far away from the electric appliance, the display screen of the electric appliance is turned off, so that the power consumption of the electric appliance can be reduced, and the electric energy is saved.
Optionally, after the face image of the triggering user is identified from the first image, if at least one face image of the user stored in advance does not have a face image matching the face image of the triggering user, an alarm message is sent out. Specifically, the alarm information may be sent to a mobile phone number of a part or all of the at least one user according to the identity information of the at least one user, or sent to law enforcement management departments such as a property and a place for dispatch.
When the facial image of the trigger user identified from the first image is not matched with the corresponding facial image, the trigger user is possibly a stranger, at the moment, alarm information is sent to the user of the electric appliance, so that the user can take corresponding countermeasures, and when illegal people are stolen or robbed in the room, effective countermeasures are taken in time, so that the safety of people and property is ensured.
The following takes an electrical appliance as an example of an air conditioner, and further details the feedback method of the electrical appliance operation information provided by the embodiment of the present invention, as shown in fig. 4, the method may include the following steps:
step 401: and acquiring and storing the operation information of the air conditioner.
In one embodiment of the invention, in the operation process of one air conditioner, the operation information of the air conditioner is collected through various types of sensors, and the collected operation information is temporarily cached. The operation information of the air conditioner comprises any one or more of operation error information of the air conditioner, abnormal information of a filter screen, fluorine deficiency prompt information of the air conditioner, equipment fault information and safety prompt information.
Step 402: acquiring a first image including a trigger user in a preset acquisition area in real time.
In one embodiment of the invention, a camera is installed on the air conditioner, and the area shot by the camera is a collection area. When a user enters the acquisition area, the user serves as a trigger user to trigger the camera to acquire an image, and the image acquired by the camera is a first image including the trigger user. For example, the camera is installed on the front panel of the air conditioner, the camera can collect images of the front area of the air conditioner at a visual angle of 160 degrees, and when a user enters the area, the camera shoots a first image including a trigger user in real time.
Step 403: the face image of the trigger user is identified from the first image, and the identity information of the trigger user is determined according to the face image of the trigger user.
In an embodiment of the present invention, after the first image is acquired, the face image of the trigger user is identified from the first image, the identified face image of the trigger user is matched with the face images of the users of the air conditioner, which are stored in advance, and the identity information of the trigger user is determined according to the identity information corresponding to the face image of the user, which is successfully matched.
For example, face images and names of 4 users of the air conditioner are stored in advance, after the face image of the trigger user is identified from the first image, the face image of the trigger user is matched with the stored 4 face images, and after the face image of the trigger user is successfully matched with the face image of the user 2, the name of the user 2 is determined as the name of the trigger user (mr. x).
Step 404: a first distance between the trigger user and the air conditioner is determined according to the first image.
In one embodiment of the invention, after the first image is acquired, a first distance between the triggering user and the air conditioner is determined according to the first image. The method for specifically determining the first distance may be the method shown in fig. 2 or fig. 3, and the specific calculation process in the above embodiment has been described in detail, and is not described herein again.
Step 405: and judging whether the first distance is within the first distance threshold range, if so, executing step 406, otherwise, executing step 409.
In an embodiment of the present invention, after the first distance is determined, it is determined whether the first distance is within a preset first distance threshold range, where the first distance threshold range is a distance range that can ensure that a user is triggered to hear the voice broadcast information. If the first distance is within the first distance threshold range, step 406 is performed accordingly, and if the first distance is outside the first distance threshold range, step 409 is performed accordingly.
For example, the preset first distance threshold range is [2m, 5m ], step 406 is performed when the first distance is determined to be 3m, and step 409 is performed when the first distance is determined to be 0.3m or 6 m.
Step 406: and judging whether the distance between the air conditioner and the trigger user on the current date is within a first distance threshold range for the first time, if so, executing step 407, and otherwise, executing step 408.
In an embodiment of the present invention, after determining that the first distance is within the first distance threshold range, further determining whether the distance between the air conditioner and the triggering user is within the first distance threshold range for the first time on the current date, if so, indicating that the distance between the air conditioner and the user is within the first distance threshold range for the first time on the current date, and if so, performing step 407 accordingly; if not, it is determined that the distance between the air conditioner and the user is within the first distance threshold range and the current date does not enter the trigger area corresponding to the first distance threshold range for the first time, and step 408 is correspondingly performed.
Step 407: and broadcasting the greeting information in a voice broadcasting mode.
In an embodiment of the present invention, after it is determined that the triggering user enters the triggering area corresponding to the first distance threshold range for the first time, greeting information corresponding to the triggering user identity information determined in step 403 is broadcasted in a voice, where the greeting information includes weather forecast information of the current date.
For example, after a user approaches an air conditioner for the first time on a certain day and enters a trigger area corresponding to a distance of [2m, 5m ] from the air conditioner, the voice is broadcasted to ' good morning, Mr. x, today's local weather is light rain, the air temperature is 20-34 ℃, and breeze, and you are advised to take an umbrella out '.
Step 408: and broadcasting the operation information in a voice broadcasting mode, and ending the current flow.
In an embodiment of the present invention, when it is detected that the first distance between the trigger user and the air conditioner is within the first distance threshold range, that is, after the trigger user enters the trigger area corresponding to the first distance threshold range, the operation information acquired and stored in step 401 is broadcasted in a voice broadcast manner, and the operation information of the air conditioner is fed back to the trigger user.
For example, after triggering the user to enter an area with a distance of [2m, 5m ] from the air conditioner, the voice broadcasts "mr. x, small Q (nickname of air conditioner) seems to leak fluorine, please handle it immediately".
Step 409: and judging whether the first distance is within the range of the second distance threshold, if so, executing the step 410, otherwise, ending the current flow.
In an embodiment of the present invention, a second distance threshold range with a maximum value smaller than the first distance threshold range is preset, and after determining that the first distance is outside the first distance threshold range, it is further determined whether the first distance is within the second distance threshold range, if so, it indicates that the triggering user has entered an area capable of operating the air conditioner, and correspondingly performs step 410, otherwise, the current process is ended.
For example, if the preset first distance threshold range is [2m, 5m ], the preset second distance threshold range is [0m, 0.5m ], and when the first distance between the air conditioner and the trigger user is detected to be 0.3m, since the first distance is not within the first distance threshold range and the first distance is within the second distance threshold range, step 410 is performed accordingly.
Step 410: and lightening a display screen of the air conditioner to display a user operation interface, and carrying out voice broadcast on prompt information that the air conditioner enters an operation waiting state.
In one embodiment of the invention, after the first distance between the trigger user and the air conditioner is determined to be within the second distance threshold range, the display screen of the air conditioner is lightened, so that the display screen of the air conditioner displays the user operation interface, and the user is prompted in a voice broadcast mode that the air conditioner enters the operation waiting state.
For example, when the distance between the trigger user and the air conditioner is within the second distance threshold range [0m, 0.5m ], the display screen of the air conditioner displays the user operation interface, and broadcasts "mr. x, small Q serves you".
Step 411: and acquiring a second image comprising the trigger user in the acquisition area, and determining a second distance between the trigger user and the air conditioner according to the second image.
In one embodiment of the invention, after the display screen of the air conditioner is lightened, a second image including the starting user is collected again in the preset collection area, and a second distance between the triggering user and the air conditioner is determined according to the second image. Specifically, the process of acquiring the second image is the same as the process of acquiring the first image, and the process of determining the second distance according to the second image is the same as the process of determining the first distance according to the first image, which is not described herein again.
Step 412: and judging whether the second distance is within the second distance threshold range, if so, executing step 413, otherwise, executing step 411.
In an embodiment of the present invention, when the first distance between the trigger user and the air conditioner is smaller than the first trigger distance threshold, and the display screen of the air conditioner is lighted, the second distance between the trigger user and the air conditioner is determined by the same method as the method for obtaining the first distance, and whether the second distance is within the second distance threshold range is determined. If the second distance between the triggering user and the air conditioner is no longer within the second distance threshold range, indicating that the triggering user has left the area where the air conditioner can be operated, then step 413 is executed accordingly; if the second distance between the triggering user and the air conditioner is still within the second distance threshold range, cheating 411 is performed, and detection of the distance between the triggering user and the air conditioner is continued.
Step 413: and extinguishing the display screen of the air conditioner, and reporting that the air conditioner enters an operation dormant state by voice.
In one embodiment of the invention, after the second distance between the triggering user and the air conditioner is determined to be out of the second distance threshold range, the display screen of the air conditioner is turned off, and the triggering user is prompted in a voice broadcast mode that the air conditioner enters the operation dormant state.
For example, after the distance between the triggering user and the air conditioner is changed from 0.3m to 1m, the display screen of the air conditioner is turned off, and the voice broadcasting of 'Mr. x, goodbye' is performed.
As shown in fig. 5, an embodiment of the present invention provides an apparatus for feeding back operation information of an electrical appliance, including: the system comprises an acquisition unit 501, a collection unit 502, a processing unit 503, a judgment unit 504 and a broadcast unit 505;
the acquiring unit 501 is configured to acquire operation information of an electrical appliance;
the acquisition unit 502 is configured to acquire a first image including a trigger user in a preset acquisition area;
the processing unit 503 is configured to determine a first distance between the trigger user and the electrical appliance according to the first image acquired by the acquisition unit 502;
the judging unit 504 is configured to judge whether the first distance determined by the processing unit 503 is within a preset first distance threshold range;
the broadcast unit 505 is configured to broadcast the operation information acquired by the acquisition unit 501 in a voice broadcast manner according to the determination result of the determination unit 504, if yes.
Optionally, as shown in fig. 6, the processing unit 503 may comprise a first identifying sub-unit 5031 and a first calculating sub-unit 5032, wherein,
the first identifying subunit 5031 is configured to identify at least two key points of the triggering user from the first image;
the first calculating subunit 5032 is configured to calculate, according to the distance between the at least two key points identified by the first identifying subunit 5031 on the first image and the predetermined standard distance between the at least two key points, a first distance between the trigger user and the appliance according to the following formula one;
the first formula comprises:
wherein H represents the first distance, n represents the number of the key points, k represents a constant, and X representsiCharacterizing a criterion distance between an ith pair of the keypoints, the xiCharacterizing a distance between an ith pair of the keypoints of the first image row.
Alternatively, as shown in fig. 7, the processing unit 503 may comprise a second identifying sub-unit 5033 and a second calculating sub-unit 5034;
the second identifying subunit 5033, configured to identify the image of the triggering user from the first image;
the second calculating subunit 5034 is configured to determine a pixel ratio of pixels occupied by the image of the trigger user identified by the second identifying subunit 5033 to total pixels of the first image, and calculate a first distance between the trigger user and the electrical appliance according to the pixel ratio by using the following formula two;
the second formula includes:
H＝K·m
wherein H characterizes the first distance, K characterizes a constant, and m characterizes the pixel ratio.
Optionally, as shown in fig. 8, the appliance operation information feedback device may further include a pre-storing unit 806, wherein,
the pre-storing unit 806 is configured to pre-store a facial image and identity information of at least one user of the electrical appliance;
the processing unit 503 is further configured to, before the broadcast unit 505 broadcasts the operation information acquired by the acquisition unit 501 in a voice broadcast manner, identify a facial image of the trigger user from the first image, compare the facial image of the trigger user with the facial image of the at least one user, and determine the identity information of the trigger user according to a correspondence between the facial image of the at least one user and the identity information, which is pre-stored by the pre-storing unit 806;
the broadcasting unit 505 is further configured to broadcast greeting information corresponding to the identity information of the trigger user determined by the processing unit 503 in a voice broadcasting mode.
Optionally, as shown in fig. 9, the appliance operation information feedback device may further include a response unit 907, wherein,
the determining unit 504 is further configured to determine whether the first distance is within a preset second distance threshold range after determining that the first distance is outside the first distance threshold range, where a maximum value of the second distance threshold range is smaller than a minimum value of the first distance threshold range;
the response unit 907 is configured to, according to the determination result of the determining unit 504, if the first distance is within the second distance threshold range, light up the display screen of the electrical appliance, so that the display screen of the electrical appliance displays a user operation interface;
the broadcast unit 505 is further configured to send, according to the determination result of the determination unit 504, a prompt message that the electrical appliance has entered an operation waiting state in a voice broadcast manner if the first distance is within the second distance threshold range.
Alternatively, as shown in FIG. 9,
the acquiring unit 502 is further configured to acquire a second image including the trigger user in the acquisition area after the determining unit 504 determines that the first distance is within the second distance threshold range;
the processing unit 503 is further configured to determine a second distance between the trigger user and the electrical appliance according to the second image acquired by the acquiring unit 502;
the judging unit 504 is further configured to judge whether the second distance determined by the processing unit 503 is outside the second distance threshold range;
the response unit 907 is further configured to, according to the determination result of the determining unit 504, if the second distance is outside the second distance threshold range, turn off the display screen of the electrical appliance;
the broadcast unit 505 is further configured to send, according to the determination result of the determining unit 504, a prompt message that the electrical appliance has entered the operation sleep state in a voice broadcast manner if the second distance is outside the second distance threshold range.
Because the information interaction, execution process, and other contents between the units in the device are based on the same concept as the method embodiment of the present invention, specific contents may refer to the description in the method embodiment of the present invention, and are not described herein again.
It should be noted that, in the actual service implementation process, the feedback device of the operation information of the electrical appliance provided in the foregoing embodiments needs to be combined with the current electrical appliance described in the foregoing embodiments. For example, when the current electric appliance is an air conditioner, the electric appliance operation information feedback device is integrated inside the casing of the air conditioner.
The method and the device for feeding back the running information of the electric appliance provided by each embodiment of the invention at least have the following beneficial effects:
1. in the embodiment of the invention, after the operation information of an electric appliance is acquired, when a trigger user enters a preset acquisition area, a first image comprising the trigger user is acquired, a first distance between the trigger user and the electric appliance is determined according to the first image, and when the first distance is within a preset first distance threshold range, the acquired operation information is broadcasted in a voice broadcast mode. Therefore, after a trigger user enters the acquisition area, a first distance between the trigger user and the electric appliance is determined by acquiring a first image comprising the trigger user, when the first distance meets a preset first distance threshold range, the distance between the trigger user and the electric appliance is indicated to enable the trigger user to hear the voice playing information, and at the moment, the running information of the electric appliance is sent to the trigger user in a voice broadcasting mode. Therefore, the user can automatically broadcast the operation information of the electric appliance by voice after the user approaches the electric appliance for a certain distance, so that the operation information of the electric appliance can be timely fed back to the user.
2. In the embodiment of the invention, when determining the first distance between the trigger and the electrical appliance according to the first image, at least two key points of the trigger user can be identified from the first image, the first distance is obtained through formula one calculation according to the distance between the at least two key points on the first image, or the image of the trigger user can be identified from the first image, and the first distance is obtained through formula two calculation according to the pixel occupied by the image of the trigger user on the first image. The two methods for determining the first distance have the characteristics, for example, the first method has higher accuracy, the second method has higher speed, and the method for determining the first distance can be selected according to actual requirements.
3. In the embodiment of the invention, by presetting the second distance threshold range, when the distance between the user and the electric appliance is within the second distance threshold range, the display screen of the electric appliance is lightened to display the user operation interface, and the user is prompted that the electric appliance enters the operable state in a voice broadcast mode. Like this, when the user is close to electrical apparatus to certain distance, the display screen of electrical apparatus lights automatically and voice prompt user's electrical apparatus has got into operational state, makes electrical apparatus more intelligent, has promoted the science and technology of electrical apparatus and has felt to user's use experience has been promoted.
4. In the embodiment of the invention, after the user approaches the electric appliance to light the display screen of the electric appliance, the distance between the user and the electric appliance is detected, and when the distance between the user and the electric appliance is out of the range of the second distance threshold value, the display screen of the electric appliance is turned off, and the user is prompted in a voice broadcast mode that the electric appliance enters the operation dormant state. Like this, after the user operates the electrical apparatus and accomplishes keeping away from the electrical apparatus, the display screen of electrical apparatus is automatic to extinguish to voice prompt user's electrical apparatus has got into operation dormancy state, has promoted the intelligent degree and the science and technology of electrical apparatus and has felt, has further promoted user's use and has experienced. Meanwhile, when the user does not operate the electric appliance, the display screen of the electric appliance is turned off, and the power consumption of the electric appliance can be reduced.
5. In the embodiment of the invention, the operation information fed back to the user comprises the fault information, the safety reminding information and the like of the electric appliance, and the user can timely maintain the electric appliance according to the fed back fault information, so that the electric appliance is prevented from being in a fault and suffering from a fire disaster, and the safety of the electric appliance is improved; the user can operate the electric appliance in a mode according with the rule according to the safety reminding information, and accidents such as electric shock and the like can be caused in the mode.
6. In the embodiment of the invention, when the distance between the user and the electric appliance for the first time is within the first distance threshold range or within the second distance threshold range every day, the weather forecast is broadcasted to the user in a voice broadcast mode, so that the use experience of the user is further improved.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a" does not exclude the presence of other similar elements in a process, method, article, or apparatus that comprises the element.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it is to be noted that: the above description is only a preferred embodiment of the present invention, and is only used to illustrate the technical solutions of the present invention, and not to limit the protection scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. An electric appliance operation information feedback method is characterized by comprising the following steps:
acquiring operation information of an electric appliance;
acquiring a first image including a trigger user in a preset acquisition area;
determining a first distance between the triggering user and the appliance according to the first image;
judging whether the first distance is within a preset first distance threshold range;
if so, broadcasting the operation information in a voice broadcasting mode.
2. The method of claim 1,
the determining a first distance between the triggering user and the appliance from the first image includes:
identifying at least two keypoints of the triggering user from the first image;
calculating a first distance between the trigger user and the electric appliance according to the distance between the at least two key points on the first image and a predetermined standard distance between the at least two key points by a first formula;
the first formula comprises:
<mrow> <mi>H</mi> <mo>=</mo> <mfrac> <mrow> <mn>2</mn> <mi>k</mi> </mrow> <mrow> <mi>n</mi> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </mfrac> <mo>&CenterDot;</mo> <munderover> <mo>&Sigma;</mo> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> </mrow> <mrow> <mi>n</mi> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </munderover> <mfrac> <msub> <mi>X</mi> <mi>i</mi> </msub> <msub> <mi>x</mi> <mi>i</mi> </msub> </mfrac> </mrow>
wherein H represents the first distance, n represents the number of the key points, k represents a constant, and X representsiCharacterizing a criterion distance between an ith pair of the keypoints, the xiCharacterizing a distance between an ith pair of the keypoints of the first image row;
or,
the determining a first distance between the triggering user and the appliance from the first image includes:
identifying an image of the triggering user from the first image;
determining a pixel ratio of pixels occupied by the image of the trigger user to total pixels of the first image;
according to the pixel ratio, calculating a first distance between the trigger user and the electric appliance through a formula II;
the second formula includes:
H＝K·m
wherein H characterizes the first distance, K characterizes a constant, and m characterizes the pixel ratio.
3. The method according to claim 1, characterized in that facial images and identity information of at least one user of the appliance are pre-stored;
before the form through the voice broadcast is to the operation information is broadcasted, further include:
identifying a facial image of the triggering user from the first image;
matching the facial image of the trigger user with the facial image of the at least one user, and determining the identity information of the trigger user according to the corresponding relation between the facial image of the at least one user and the identity information;
and broadcasting greeting information corresponding to the identity information of the trigger user in a voice broadcasting mode.
4. The method according to any one of claims 1 to 3,
after the determining whether the first distance is within a preset first distance threshold range, further comprising:
if the first distance is out of the first distance threshold range, judging whether the first distance is in a preset second distance threshold range, wherein the maximum value of the second distance threshold range is smaller than the minimum value of the first distance threshold range;
if so, lightening the display screen of the electric appliance, enabling the display screen of the electric appliance to display a user operation interface, and sending out prompt information that the electric appliance enters an operation waiting state in a voice broadcasting mode.
5. The method of claim 4,
after determining that the first distance is within the second distance threshold range, further comprising:
acquiring a second image including the trigger user within the acquisition area;
determining a second distance between the triggering user and the appliance according to the second image;
judging whether the second distance is out of the second distance threshold range;
if yes, the display screen of the electric appliance is turned off, and prompt information that the electric appliance is in the operation dormant state is sent out in a voice broadcasting mode.
6. An electric appliance operation information feedback device, comprising: the device comprises an acquisition unit, a collection unit, a processing unit, a judgment unit and a broadcast unit;
the acquisition unit is used for acquiring the operation information of an electric appliance;
the acquisition unit is used for acquiring a first image including a trigger user in a preset acquisition area;
the processing unit is used for determining a first distance between the trigger user and the electric appliance according to the first image acquired by the acquisition unit;
the judging unit is used for judging whether the first distance determined by the processing unit is within a preset first distance threshold range or not;
and the broadcasting unit is used for broadcasting the operation information acquired by the acquiring unit in a voice broadcasting mode according to the judgment result of the judging unit if the operation information is acquired by the judging unit.
7. The apparatus of claim 6,
the processing unit includes: a first identifying subunit and a first calculating subunit;
the first identification subunit is configured to identify at least two key points of the trigger user from the first image;
the first calculating subunit is configured to calculate, according to the distance between the at least two key points identified by the first identifying subunit on the first image and a predetermined standard distance between the at least two key points, a first distance between the trigger user and the electrical appliance according to a first formula;
the first formula comprises:
<mrow> <mi>H</mi> <mo>=</mo> <mfrac> <mrow> <mn>2</mn> <mi>k</mi> </mrow> <mrow> <mi>n</mi> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </mfrac> <mo>&CenterDot;</mo> <munderover> <mo>&Sigma;</mo> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> </mrow> <mrow> <mi>n</mi> <mrow> <mo>(</mo> <mi>n</mi> <mo>-</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </munderover> <mfrac> <msub> <mi>X</mi> <mi>i</mi> </msub> <msub> <mi>x</mi> <mi>i</mi> </msub> </mfrac> </mrow>
wherein H represents the first distance, n represents the number of the key points, k represents a constant, and X representsiCharacterizing a criterion distance between an ith pair of the keypoints, the xiCharacterizing a distance between an ith pair of the keypoints of the first image row;
or,
the processing unit includes: a second identifying subunit and a second calculating subunit;
the second identifying subunit is configured to identify the image of the trigger user from the first image;
the second calculating subunit is configured to determine a pixel ratio of pixels occupied by the image of the trigger user identified by the second identifying subunit to total pixels of the first image, and calculate a first distance between the trigger user and the electrical appliance according to the pixel ratio by using a second formula;
the second formula includes:
H＝K·m
wherein H characterizes the first distance, K characterizes a constant, and m characterizes the pixel ratio.
8. The apparatus of claim 6, further comprising: a pre-storing unit;
the pre-storage unit is used for pre-storing the facial image and the identity information of at least one user of the electric appliance;
the processing unit is further configured to, before the broadcasting unit broadcasts the operation information acquired by the acquisition unit in a voice broadcasting manner, identify a facial image of the trigger user from the first image, compare the facial image of the trigger user with the facial image of the at least one user, and determine the identity information of the trigger user according to a correspondence between the facial image of the at least one user and the identity information, which is prestored by the prestoring unit;
the broadcasting unit is further used for broadcasting greeting information corresponding to the identity information of the triggering user determined by the processing unit in a voice broadcasting mode.
9. The apparatus of any of claims 6 to 8, further comprising: a response unit;
the determining unit is further configured to determine whether the first distance is within a preset second distance threshold range after determining that the first distance is outside the first distance threshold range, where a maximum value of the second distance threshold range is smaller than a minimum value of the first distance threshold range;
the response unit is used for lightening a display screen of the electrical appliance to enable the display screen of the electrical appliance to display a user operation interface if the first distance is within the second distance threshold range according to the judgment result of the judgment unit;
and the broadcast unit is further used for sending a prompt message that the electric appliance has entered an operation waiting state in a voice broadcast mode according to the judgment result of the judgment unit and if the first distance is within the second distance threshold range.
10. The apparatus of claim 9,
the acquisition unit is further used for acquiring a second image comprising the trigger user in the acquisition area after the judgment unit judges that the first distance is within the second distance threshold range;
the processing unit is further used for determining a second distance between the trigger user and the electric appliance according to the second image acquired by the acquisition unit;
the judging unit is further used for judging whether the second distance determined by the processing unit is out of the second distance threshold range;
the response unit is further used for turning off the display screen of the electrical appliance according to the judgment result of the judgment unit if the second distance is out of the second distance threshold range;
and the broadcast unit is further used for sending a prompt message that the electric appliance enters the operation dormant state in a voice broadcast mode according to the judgment result of the judgment unit and if the second distance is out of the second distance threshold range.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710379248.7A CN107065622A (en) | 2017-05-25 | 2017-05-25 | A kind of electric operation information feedback method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710379248.7A CN107065622A (en) | 2017-05-25 | 2017-05-25 | A kind of electric operation information feedback method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107065622A true CN107065622A (en) | 2017-08-18 |
Family
ID=59609823
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710379248.7A Pending CN107065622A (en) | 2017-05-25 | 2017-05-25 | A kind of electric operation information feedback method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107065622A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107678649A (en) * | 2017-09-27 | 2018-02-09 | 深圳市欧瑞博电子有限公司 | The method for information display and device of intelligent panel |
| CN108053820A (en) * | 2017-12-13 | 2018-05-18 | 广东美的制冷设备有限公司 | The voice broadcast method and device of air regulator |
| CN108154877A (en) * | 2017-12-13 | 2018-06-12 | 广东美的制冷设备有限公司 | The voice broadcast method and device of air regulator |
| CN110390938A (en) * | 2018-04-20 | 2019-10-29 | 比亚迪股份有限公司 | Method of speech processing, device and terminal device based on vocal print |
| CN113903337A (en) * | 2021-10-13 | 2022-01-07 | 海尔(深圳)研发有限责任公司 | Method and device for controlling voice air conditioner, cloud server and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1667532A (en) * | 2004-03-12 | 2005-09-14 | 联想(北京)有限公司 | Media play device capable of range information interaction with users and implementation method thereof |
| CN101074876A (en) * | 2007-06-26 | 2007-11-21 | 北京中星微电子有限公司 | Method and device for automatically measuring distance |
| JP2010273276A (en) * | 2009-05-25 | 2010-12-02 | Car Mate Mfg Co Ltd | Television control device |
| CN104506940A (en) * | 2014-12-15 | 2015-04-08 | 四川长虹电器股份有限公司 | Information processing method and television |
| CN105704472A (en) * | 2016-01-13 | 2016-06-22 | 青岛海信电器股份有限公司 | Television control method capable of identifying child user and system thereof |
| CN106338181A (en) * | 2016-11-10 | 2017-01-18 | 四川长虹电器股份有限公司 | Voice Reminding System Applied in Refrigerator and Voice Reminding Methods |
| CN106705385A (en) * | 2017-02-14 | 2017-05-24 | 珠海格力电器股份有限公司 | Control method, control device and control system of air conditioner |
-
2017
- 2017-05-25 CN CN201710379248.7A patent/CN107065622A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1667532A (en) * | 2004-03-12 | 2005-09-14 | 联想(北京)有限公司 | Media play device capable of range information interaction with users and implementation method thereof |
| CN101074876A (en) * | 2007-06-26 | 2007-11-21 | 北京中星微电子有限公司 | Method and device for automatically measuring distance |
| JP2010273276A (en) * | 2009-05-25 | 2010-12-02 | Car Mate Mfg Co Ltd | Television control device |
| CN104506940A (en) * | 2014-12-15 | 2015-04-08 | 四川长虹电器股份有限公司 | Information processing method and television |
| CN105704472A (en) * | 2016-01-13 | 2016-06-22 | 青岛海信电器股份有限公司 | Television control method capable of identifying child user and system thereof |
| CN106338181A (en) * | 2016-11-10 | 2017-01-18 | 四川长虹电器股份有限公司 | Voice Reminding System Applied in Refrigerator and Voice Reminding Methods |
| CN106705385A (en) * | 2017-02-14 | 2017-05-24 | 珠海格力电器股份有限公司 | Control method, control device and control system of air conditioner |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107678649A (en) * | 2017-09-27 | 2018-02-09 | 深圳市欧瑞博电子有限公司 | The method for information display and device of intelligent panel |
| CN107678649B (en) * | 2017-09-27 | 2020-11-20 | 深圳市欧瑞博科技股份有限公司 | Information display method and device of intelligent panel |
| CN108053820A (en) * | 2017-12-13 | 2018-05-18 | 广东美的制冷设备有限公司 | The voice broadcast method and device of air regulator |
| CN108154877A (en) * | 2017-12-13 | 2018-06-12 | 广东美的制冷设备有限公司 | The voice broadcast method and device of air regulator |
| CN108154877B (en) * | 2017-12-13 | 2021-12-17 | 广东美的制冷设备有限公司 | Voice broadcasting method and device of air conditioner |
| CN110390938A (en) * | 2018-04-20 | 2019-10-29 | 比亚迪股份有限公司 | Method of speech processing, device and terminal device based on vocal print |
| CN113903337A (en) * | 2021-10-13 | 2022-01-07 | 海尔(深圳)研发有限责任公司 | Method and device for controlling voice air conditioner, cloud server and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107065622A (en) | A kind of electric operation information feedback method and device | |
| US11727788B2 (en) | DIY monitoring apparatus and method | |
| CN111086410B (en) | Charging control method and device, electronic equipment and system | |
| CN108354526B (en) | Security method and device for sweeping robot | |
| CN107678649A (en) | The method for information display and device of intelligent panel | |
| CN104406267B (en) | Point out the method and device of air cleaning facility working condition | |
| CN107170212B (en) | User exit reminding method and system and intelligent home service terminal | |
| CN106705385A (en) | Control method, control device and control system of air conditioner | |
| CN112032988B (en) | Control system and method of air conditioner and electronic equipment | |
| CN110685119B (en) | Washing machine and system and method for guaranteeing safety of children | |
| WO2001001363A1 (en) | Monitoring system | |
| CN102984366A (en) | Clothing reminding method and system | |
| CN109405199B (en) | Controller control method and device, controller and air conditioner | |
| CN112000156A (en) | Power-off method, device and system of intelligent household appliance and computer readable storage medium | |
| KR102158840B1 (en) | Sensing system and method for firre in realtime | |
| CN105955212A (en) | Smart home platform and smart home platform based home environment monitoring method | |
| CN110490120B (en) | Dangerous behavior detection method and device, server and storage medium | |
| WO2019079862A1 (en) | Fire detection system, automatic data capture, remote testing, analysis, apparatus and methods | |
| CN105872466A (en) | Alarm method and alarm device based on smart TV | |
| CN114385287B (en) | Presentation content determining method, apparatus, electronic device and storage medium | |
| US20140036056A1 (en) | Monitoring system and monitoring method thereof | |
| CN108131892B (en) | Intelligent refrigerator and setting method thereof | |
| CN109215299A (en) | A kind of intelligent electric appliance early warning system | |
| CN107872372B (en) | Reminding setting method and system for food in refrigerator | |
| CN210667733U (en) | Electronic advertisement display equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 621050 No. 303 Jiuzhou Road, Fucheng District, Mianyang, Sichuan. Applicant after: SICHUAN HONGMEI INTELLIGENT TECHNOLOGY Co.,Ltd. Address before: 621050 No. 303 Jiuzhou Road, Fucheng District, Mianyang, Sichuan. Applicant before: MIANYANG MEILING SOFTWARE TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190125 Address after: 230000 No. 2163 Lianhua Road, Hefei economic and Technological Development Zone, Anhui Applicant after: CHANGHONG MEILING Co.,Ltd. Address before: 621050 No. 303 Jiuzhou Road, Fucheng District, Mianyang, Sichuan. Applicant before: SICHUAN HONGMEI INTELLIGENT TECHNOLOGY Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170818 |