CN110916614A - User sleep monitoring method and device and intelligent ceiling fan - Google Patents
User sleep monitoring method and device and intelligent ceiling fan Download PDFInfo
- Publication number
- CN110916614A CN110916614A CN201911192837.XA CN201911192837A CN110916614A CN 110916614 A CN110916614 A CN 110916614A CN 201911192837 A CN201911192837 A CN 201911192837A CN 110916614 A CN110916614 A CN 110916614A
- Authority
- CN
- China
- Prior art keywords
- user
- sleep
- dangerous
- bed
- sleeping
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000007958 sleep Effects 0.000 title claims abstract description 136
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000012544 monitoring process Methods 0.000 title claims abstract description 37
- 230000006399 behavior Effects 0.000 claims abstract description 94
- 238000012545 processing Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 4
- 230000005236 sound signal Effects 0.000 claims description 4
- 230000001815 facial effect Effects 0.000 claims description 3
- 230000036544 posture Effects 0.000 description 24
- 238000004891 communication Methods 0.000 description 11
- 230000029058 respiratory gaseous exchange Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000002618 waking effect Effects 0.000 description 3
- 206010021143 Hypoxia Diseases 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 2
- 238000001816 cooling Methods 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000474 nursing effect Effects 0.000 description 2
- 206010003497 Asphyxia Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000009193 crawling Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000004297 night vision Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001314 paroxysmal effect Effects 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000003860 sleep quality Effects 0.000 description 1
- 230000036578 sleeping time Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4806—Sleep evaluation
- A61B5/4809—Sleep detection, i.e. determining whether a subject is asleep or not
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F5/00—Orthopaedic methods or devices for non-surgical treatment of bones or joints; Nursing devices; Anti-rape devices
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Pathology (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Physics & Mathematics (AREA)
- Anesthesiology (AREA)
- Nursing (AREA)
- Orthopedic Medicine & Surgery (AREA)
- Vascular Medicine (AREA)
- Physiology (AREA)
- Alarm Systems (AREA)
Abstract
The embodiment of the invention relates to the technical field of electronic information, in particular to a method and a device for monitoring sleep of a user and an intelligent ceiling fan, wherein the method comprises the steps of collecting images of a sleep bed, and identifying the sleep state of the user lying on the sleep bed and whether dangerous behaviors exist in the user or not according to the images; and if the user has dangerous behaviors, carrying out dangerous treatment by combining the sleep state. By the method, the dangerous behaviors of the user can be recognized, the guardian can be timely reminded when danger occurs, and the danger can be automatically handled, so that the danger is relieved, the safety performance is high, and the burden of the guardian is reduced.
Description
Technical Field
The embodiment of the invention relates to the technical field of electronic information, in particular to a method and a device for monitoring sleep of a user and an intelligent ceiling fan.
Background
Along with scientific progress and innovation, an intelligent algorithm is gradually popularized, and an artificial intelligence technology is used in more and more scenes in life, particularly for monitoring and nursing of children, so that adults are helped to relieve nursing burden, and meanwhile, safety is improved.
The child is easy to have safety accidents during sleeping due to poor activity self-care capability, for example, the child climbs after waking up to cause collision or fall injury, and is blocked by objects such as quilts and the like during sleeping to breathe, so that guardians such as parents and the like need to monitor in real time, and the guardians are heavy in tasks and cannot be around the child at all times, for example, housework needs to be done and the like.
In the process of implementing the embodiment of the present invention, the inventor of the present invention finds that: at present, mostly with wearing equipment, for example sleep monitor bracelet, monitor children user's sleep, alarm when discovering unusually or dangerous and inform guardians, however dangerous is a moment, and guardians arrives children and needs time, consequently, this type of wearing equipment can't in time stop dangerous emergence.
Disclosure of Invention
The embodiment of the invention mainly solves the technical problem of providing a method and a device for monitoring the sleep of a user and an intelligent ceiling fan, which can identify dangerous behaviors of the user and carry out dangerous treatment.
In order to solve the above technical problem, in a first aspect, an embodiment of the present invention provides a method for monitoring sleep of a user, including:
collecting images of a sleeping bed;
according to the image, identifying the sleeping state of the user lying on the sleeping bed and whether dangerous behaviors exist in the user;
and if the user has dangerous behaviors, carrying out dangerous treatment by combining the sleep state.
In some embodiments, the sleep states include a wake state and a deep sleep state;
the step of performing hazard treatment in combination with the sleep state further comprises:
if the sleep state is a wake-up state, controlling the intelligent ceiling fan to output an attraction signal for absorbing the attention of a user;
and if the sleep state is a sound sleep state, sending a reminding signal to an intelligent terminal for monitoring the user.
In some embodiments, the method further comprises:
judging whether a release condition for releasing the attraction signal is satisfied;
and if so, controlling the intelligent ceiling fan to stop outputting the suction signal.
In some embodiments, the release condition includes outputting the attraction signal for a predetermined period of time, or recognizing that the dangerous behavior of the user has been released.
In some embodiments, the attraction signal comprises a light signal or/and an audio signal.
In some embodiments, the step of identifying whether the user has dangerous behaviors according to the image further includes:
identifying whether the user is located at the edge of the sleeping bed according to the image;
if the user is located at the edge of the sleeping bed, identifying whether a guardrail exists at the edge of the sleeping bed;
if the guardrail does not exist, determining that dangerous behaviors exist in the user;
and if the guardrail exists, determining that the user does not have dangerous behaviors.
In some embodiments, the step of identifying whether the user has dangerous behaviors according to the images further comprises
Recognizing the sleep posture of the user according to the image;
if the sleeping posture is a sleep-off posture, acquiring the face posture of the user;
when the face pose is a side face pose, obtaining the duration of the user for the side face pose;
judging whether the duration time is greater than preset time or not;
if so, determining that the user has dangerous behaviors;
and if not, determining that the user has no dangerous behaviors.
In order to solve the above technical problem, in a second aspect, an embodiment of the present invention provides an apparatus for monitoring sleep of a user, including:
the image acquisition module is used for acquiring images of the sleep bed;
the recognition module is used for recognizing the sleeping state of the user lying on the sleeping bed and whether dangerous behaviors exist in the user or not according to the image;
and the processing module is used for carrying out danger processing by combining the sleep state if the user has dangerous behaviors.
In order to solve the above technical problem, in a third aspect, an embodiment of the present invention provides an intelligent ceiling fan, including:
a ceiling fan main body;
the image acquisition module is used for acquiring images of the sleep bed;
the danger processing module is used for carrying out danger processing by combining the sleep state if the user has dangerous behaviors;
the at least one processor is respectively connected with the image acquisition module and the danger processing module; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first aspect as described above.
In order to solve the above technical problem, in a fourth aspect, the present invention provides a computer program product including program code, which, when run on an electronic device, causes the electronic device to perform the method according to the first aspect.
The embodiment of the invention has the following beneficial effects: different from the situation of the prior art, the method, the device and the intelligent ceiling fan for monitoring the sleep of the user provided by the embodiment of the invention have the advantages that the sleep state of the user lying on the sleep bed and whether dangerous behaviors exist in the user are identified by acquiring the image of the sleep bed according to the image; and if the user has dangerous behaviors, carrying out dangerous treatment by combining the sleep state. By the method, the dangerous behaviors of the user can be recognized, the guardian can be timely reminded when danger occurs, and the danger can be automatically handled, so that the danger is relieved, the safety performance is high, and the burden of the guardian is reduced.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the figures in which like reference numerals refer to similar elements and which are not to scale unless otherwise specified.
Fig. 1 is a schematic diagram of an application environment of an embodiment of a method of user sleep monitoring of an embodiment of the present invention;
fig. 2 is a flowchart of a method for monitoring sleep of a user according to an embodiment of the present invention;
FIG. 3 is a sub-flowchart of the method of FIG. 2 for identifying whether a dangerous behavior exists in the user based on the image in step 120;
FIG. 4 is another sub-flowchart of the method of FIG. 2 for identifying whether a user has dangerous behavior based on the image in step 120;
FIG. 5 is a sub-flowchart of step 130 of the method of FIG. 2;
FIG. 6 is another sub-flow diagram of step 130 of the method of FIG. 2;
fig. 7 is a schematic structural diagram of an apparatus for monitoring sleep of a user according to an embodiment of the present invention;
fig. 8 is a schematic hardware structure diagram of an intelligent ceiling fan for implementing the method for monitoring the user sleep according to the embodiment of the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications can be made by persons skilled in the art without departing from the spirit of the invention. All falling within the scope of the present invention.
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It should be noted that, if not conflicted, the various features of the embodiments of the invention may be combined with each other within the scope of protection of the present application. Additionally, while functional block divisions are performed in apparatus schematics, with logical sequences shown in flowcharts, in some cases, steps shown or described may be performed in sequences other than block divisions in apparatus or flowcharts. Further, the terms "first," "second," "third," and the like, as used herein, do not limit the data and the execution order, but merely distinguish the same items or similar items having substantially the same functions and actions.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
Fig. 1 is a schematic diagram of an exemplary system structure applied to an embodiment of the method for monitoring sleep of a user according to the present invention. As shown in fig. 1, the system architecture includes: an intelligent ceiling fan 10 comprising a ceiling fan body 11 and an electronic device 12, and a video camera 20.
The ceiling fan main body 11 is arranged above the sleeping bed and can fan and cool the whole sleeping bed area.
With respect to the electronic device 12 and the camera 20, the electronic device 12 and the camera 20 are communicatively connected, and the communication connection may be a wired connection, for example: fiber optic cables, and also wireless communication connections, such as: WIFI connection, bluetooth connection, 4G wireless communication connection, 5G wireless communication connection and so on.
The camera 20 is disposed above the sleep bed and can acquire images of the sleep bed, including the entire sleep bed area. The camera 20 is a device capable of acquiring an image, where the image may be a video or a picture, and the picture is taken as an example in the embodiment of the present invention. The camera 20 may be a device for capturing images, such as a camera, a camera phone, a video recorder, a video camera, or a night vision device, and the camera 20 may be communicatively connected to the electronic device 12 to transmit image information captured in real time to the electronic device 12.
The electronic device 12 can recognize the sleep state of the user and whether dangerous behaviors exist, and perform dangerous handling. Specifically, the electronic device 12 can identify the sleep state of the user lying on the sleep bed and whether the user has dangerous behaviors according to the acquired image of the sleep bed; and if the user has dangerous behaviors, carrying out dangerous treatment by combining the sleep state.
The electronic device 12 is a device capable of storing a large amount of image data and performing arithmetic processing on the image data, and may be, for example, a physical terminal server, and is connected to the camera 20 through a network by communication via a predetermined communication protocol. Further, the system may also be a cloud server, a cloud host, a cloud service platform, a cloud computing platform, and the like, and the system may also be capable of being connected to the camera through a network in a communication manner through a certain communication protocol. The network can be an ethernet or a local area network, the communication protocol can be TCP/IP, NETBEUI, IPX/SPX and other communication protocols, and the communication connection can be a wireless connection or a wired connection, and in particular, can be set according to actual needs.
It can be understood that: the electronic device 12 and camera 20 may also be integrated together as an integral device, or alternatively, the electronic device 12 and camera 20 may be integrated onto the intelligent ceiling fan 10 as part of the intelligent ceiling fan 10. The intelligent ceiling fan 10 or the camera 20 can be arranged above the sleeping bed to collect images of the whole sleeping bed area, and can also be used for cooling the whole sleeping bed area by fanning.
An embodiment of the present invention provides a method for monitoring sleep of a user applied to the application environment, where the method is executable by the electronic device, please refer to fig. 2, and the method includes:
step 110: collecting images of a sleeping bed;
in an embodiment of the present invention, the image of the sleeping bed may be acquired by a camera as described in fig. 1 above. The camera can be arranged above the sleeping bed and is used for collecting the whole sleeping bed area, and the image of the sleeping bed comprises user image information and/or environment image information of the sleeping bed so as to carry out the next judgment and processing.
Step 120: and identifying the sleeping state of the user lying on the sleeping bed and whether dangerous behaviors exist in the user or not according to the image.
In the embodiment of the present invention, the sleep states of the user include a wake-up state and a sound sleep state, the wake-up state refers to a state in which the user wakes up from sleep, and the sound sleep state refers to a state in which the user is sleeping. The dangerous behaviors refer to behaviors that threaten the safety of the user, for example, the user tends to fall off the bed at the edge of a sleeping bed, and the face of the user is blocked from breathing by quilt and other objects in the sleeping process. And identifying the dangerous behaviors, wherein the dangerous behaviors are mainly judged according to the sleeping postures, the body positions and the face states of the users in the images.
It is understood that the sleep state can be recognized by using the existing face recognition algorithm, and the sleep state of the user can be judged by extracting the geometric features of the face and according to the eye features or the facial action features. The face recognition algorithm can be selected from the existing geometric feature algorithm, a local binary pattern method, an Openface or a convolutional neural network. Of course, the face recognition algorithm may also be used to recognize the dangerous behavior, such as the face of the user being blocked from breathing by a quilt or other object during sleep
It will be appreciated that identifying the dangerous behaviour may also be combined with existing target detection algorithms to identify the position of the user in the sleeping bed to determine if the user is at risk of falling. The target detection algorithm can be a current one-stage or two-stage algorithm.
The acquired images are input into one or more trained recognition algorithm models, and then the sleeping state of the user and whether dangerous behaviors exist can be detected.
In some embodiments, referring to fig. 3, the step of identifying whether the user has dangerous behavior according to the image further includes:
step 121 a: and identifying whether the user is positioned at the edge of the sleeping bed according to the image.
In dangerous behaviors, falling injuries of awake users caused by moving to the edge of a sleeping bed, which often occurs, is one of the most common dangerous behaviors, and therefore, different protective measures are usually taken by guardians. In this embodiment, whether the user is in a dangerous behavior is determined according to different precautionary measures, so as to avoid misdetermination.
Step 122 a: if the user is located at the edge of the sleeping bed, identifying whether a guardrail exists at the edge of the sleeping bed.
The guardrail is added at the edge of the sleeping bed, which is a common protection measure, so that the accuracy of judging dangerous behaviors is improved, and whether the guardrail exists at the edge of the sleeping bed or not is identified.
Step 123 a: if the guardrail does not exist, determining that dangerous behaviors exist in the user;
when the guardrail is not installed at the edge of the sleeping bed, the user is located at the edge of the sleeping bed, the risk of falling off from the sleeping bed exists, and the user can be determined to have dangerous behaviors.
Step 124 a: and if the guardrail exists, determining that the user does not have dangerous behaviors.
When the guardrail is installed at the edge of the sleeping bed, due to the protection effect of the guardrail, the user can be safely positioned at the edge of the sleeping bed, and the user can be determined to have no dangerous behaviors.
In some embodiments, referring to fig. 4, for dangerous behaviors caused by a sleep posture, the step of identifying whether the dangerous behaviors exist in the user according to the image further includes:
step 121 b: and recognizing the sleep posture of the user according to the image.
The sleep posture refers to the posture of a user during sleep, and comprises the following steps: supine sleeping position, lying on back sleeping position, lying on side sleeping position, crouching sleeping position, pillow arm sleeping position and the like, wherein the health of the children is influenced by long-time lying on back sleeping position due to the fact that the children in the growing period are fragile. Therefore, after the sleep posture of the user is recognized, the next judgment is carried out.
Step 122 b: and if the sleeping posture is taken off, acquiring the face posture of the user.
The long-time sleep-taking can press the heart and the lung to influence the respiration, and even the user can not move due to the long-time sleep-taking and insufficient respiration. When the sleep posture of the user is recognized as sleep-off, the sleep-off duration of the user should be detected. In this embodiment, the sleeping time of the user is determined by obtaining the face posture of the user, and then whether the user has dangerous behaviors caused by sleeping for too long is determined.
Step 123 b: when the facial pose is a face oriented toward the sleep bed, a duration of time the user's face is oriented toward the sleep bed is obtained.
When the user sleeps, one side of the face generally needs to contact with articles such as a pillow and the like, the face posture is a side face posture, however, for the user with weak activity self-care capability, the situation that the whole face faces the sleep bed is very likely to occur, and the user cannot turn over or adjust the face posture by himself or herself, so that the breathing is hindered by the sleep bed, oxygen deficiency is easily caused, and dangerous accidents such as suffocation can be caused if the time that the face faces the sleep bed is too long.
Therefore, by detecting the face posture, when it is detected that the face is oriented toward the sleep bed, the duration is calculated, thereby acquiring the duration that the face of the user is oriented toward the sleep bed.
Step 124 b: judging whether the duration time is greater than preset time or not; if yes, go to step 125b, otherwise go to step 126 b.
The preset time can be an empirical value obtained through scientific experiments, or can be set by a guardian according to the habit of the user.
Step 125 b: determining that dangerous behaviors exist in the user;
if the duration time of the face facing the sleeping bed is longer than the preset time, the breathing of the user is obstructed by the sleeping bed, oxygen deficiency is easily caused, and the user can be determined to have dangerous behaviors.
Step 126 b: it is determined that no dangerous behavior exists for the user.
If the duration time of the face facing the sleeping bed is shorter than the preset time, the sleeping posture of the user is adjusted, the user breathes smoothly, and the user can be determined to have no dangerous behaviors.
Step 130: and if the user has dangerous behaviors, carrying out dangerous treatment by combining the sleep state.
When the user has dangerous behaviors, dangerous treatment in different modes is carried out according to different sleep states. Wherein the sleep state comprises a wake-up state and a sound sleep state. Dangerous behaviors of a user during waking usually have instantaneity and paroxysmal behaviors, for example, a waking child climbs to the edge of a bed, and should first try to avoid, slow down the dangerous behaviors and then inform a guardian in time. Dangerous behaviors of the user during sleep are accumulated for a long time, for example, the face of the user is shielded by objects such as a quilt to influence breathing, and a guardian should be informed to adjust in time to avoid danger.
In some embodiments, referring to fig. 5, when the user has dangerous behavior, the step 130 specifically includes:
step 131: if the sleep state is a wake-up state, controlling the intelligent ceiling fan to output an attraction signal for absorbing the attention of a user; if the sleep state is a sound sleep state, step 134 is executed.
When a user wakes up, a guardian may not find that the user may roll over, crawl or cry on a sleeping bed, dangerous behaviors such as crawling to the edge of the sleeping bed or colliding with other objects exist, and at the moment, the emotion and the behaviors of the user should be stabilized firstly. In the embodiment, the intelligent ceiling fan is controlled to output the attraction signal for absorbing the attention of the user so as to stabilize the emotion and behavior of the user, relieve the danger and inform the guardian of preventing the impending dangerous behavior.
Step 134: and sending a reminding signal to an intelligent terminal for monitoring the user.
When the user is in a deep sleep state, the user has no activity ability, and dangerous behaviors, such as the user being blocked from breathing with a sleeping posture or articles, should be timely notified to the guardian to relieve the danger. In this embodiment, a warning signal is generated to an intelligent terminal for monitoring the user, so as to notify monitoring personnel. The intelligent terminal can be a smart phone, a tablet or a smart watch. The reminding signal can be a preset alarm or light flashing and the like. It is understood that the preset alarm or light flashing can be set by a supervisor according to the habit or acceptable degree of the user, so that the user can predict the danger degree in advance and respond differently in time.
In some embodiments, referring to fig. 6, in order to prevent interference to the sleep quality of the user due to the transient release of the attraction signal, after step 131, the method further includes:
step 132: judging whether a release condition for releasing the attraction signal is satisfied; if so, step 133 is performed.
When the dangerous behavior of the user is relieved, for example, the user moves to a safe position from the edge of the sleeping bed, the user gradually enters a sleeping state from a sleep-waking state, and at the moment, if the attraction signal is continuously released, the user is disturbed to sleep. Whether the releasing condition for releasing the attraction signal is met or not is judged, and reasonable adjustment is made according to different conditions, so that the safety of a user is guaranteed, and the sleep of the user is facilitated.
In some embodiments, the release condition includes outputting the attraction signal for a predetermined period of time, or recognizing that the dangerous behavior of the user has been released. The preset time length for outputting the attraction signal means that the preset time length is set for the output attraction signal, the attraction signal is automatically stopped after the output of the attraction signal reaches a certain time, at the moment, if the dangerous behavior is not stopped, the attraction signal is continuously released, if the dangerous behavior is eliminated, the attraction signal is not released, and the user enters normal sleep. Namely, the time length of the playing of the attraction signal is set to prevent the attraction signal from being released excessively and disturbing the sleep of the user. If the dangerous behavior of the user is identified to be relieved, the attraction signal is timely stopped being output no matter the user is released within the preset time length, and the effect of reducing sleep interference is achieved.
In some embodiments, the attraction signal comprises a light signal or/and an audio signal. It can be understood that the supervisor can set the attraction signal according to the requirement of the supervisor, and the user experience is met.
Step 133: and controlling the intelligent ceiling fan to stop outputting the suction signal.
When the release condition for releasing the attraction signal is satisfied, the interference of the user sleep can be avoided.
According to the method for monitoring the sleep of the user, provided by the embodiment of the invention, the sleep state of the user lying on the sleep bed and whether dangerous behaviors exist in the user are identified by acquiring the image of the sleep bed according to the image; and if the user has dangerous behaviors, carrying out dangerous treatment by combining the sleep state. By the method, the dangerous behaviors of the user can be recognized, the guardian can be timely reminded when danger occurs, and the danger can be automatically handled, so that the danger is relieved, the safety performance is high, and the burden of the guardian is reduced.
The embodiment of the present invention further provides a device for monitoring user sleep, where the device for monitoring user sleep is applied to an intelligent ceiling fan, please refer to fig. 7, which shows a structure of the device for monitoring user sleep provided in the embodiment of the present application, where the device 200 for monitoring user sleep includes: an image acquisition module 210, a recognition module 220 and a processing module 230.
The image collecting module 210 is configured to collect an image of the sleep bed. The identification module 220 is configured to identify a sleep state of the user lying on the sleep bed and whether the user has dangerous behaviors according to the image. And a processing module 230, configured to perform hazard handling in combination with the sleep state if the user has a hazardous behavior.
In some embodiments, the sleep states include a wake state and a deep sleep state. The processing module 230 further includes a first control unit and a reminding unit (not shown), wherein the first control unit is configured to control the intelligent ceiling fan to output an attraction signal for drawing the attention of the user if the sleep state is a wake-up state. And the reminding unit is used for sending a reminding signal to an intelligent terminal for monitoring the user if the sleep state is a sound sleep state.
In some embodiments, the processing module 230 further includes a first judging unit and a second controlling unit (not shown), and the first judging unit is configured to judge whether a releasing condition for releasing the attraction signal is satisfied. And the second control unit is used for controlling the intelligent ceiling fan to stop outputting the suction signal if a removing condition for removing the suction signal is met. In some embodiments, the release condition includes outputting the attraction signal for a predetermined period of time, or recognizing that the dangerous behavior of the user has been released. In some embodiments, the attraction signal comprises a light signal or/and an audio signal.
In some embodiments, the identification module 220 further comprises: a first recognition unit, a second recognition unit, a first determination unit and a second determination unit (not shown). The first identification unit is used for identifying whether the user is located at the edge of the sleeping bed according to the image. The second identification unit is used for identifying whether a guardrail exists at the edge of the sleeping bed or not if the user is located at the edge of the sleeping bed. The first determination unit is used for determining that dangerous behaviors exist in the user if the guardrail does not exist. The second determination unit is used for determining that the user has no dangerous behaviors if the guardrail exists.
In some embodiments, the identification module 220 further comprises: a third identification unit, a first acquisition unit, a second judgment unit, a third determination unit, and a fourth determination unit (not shown). The third identification unit is used for identifying the sleeping posture of the user according to the image. The first obtaining unit is used for obtaining the face posture of the user if the sleep posture is taken off. The second acquisition unit is used for acquiring the duration of the face of the user facing the sleep bed when the face posture is that the face faces the sleep bed. The second judging unit is configured to judge whether the duration is greater than a preset time. And the third determining unit is used for determining that the user has dangerous behaviors if the duration is longer than the preset time. The fourth determining unit is configured to determine that the user has no dangerous behavior if the duration is less than a preset time.
In the embodiment of the present invention, the device 200 for monitoring the sleep of the user applied to the intelligent ceiling fan acquires the image of the sleep bed through the image acquisition module 210, the identification module 220 identifies the sleep state of the user lying on the sleep bed and whether the user has dangerous behaviors or not according to the image, and if the user has dangerous behaviors, the processing module 230 performs dangerous processing by combining the sleep state. Through the device 200, dangerous behaviors of a user can be recognized, when danger occurs, a guardian can be timely reminded, and the danger can be automatically handled, so that the danger is relieved, the safety performance is high, and on the other hand, the burden of the guardian is also reduced.
The embodiment of the present invention further provides an intelligent ceiling fan, which is disposed above a sleeping bed, and referring to fig. 8, the intelligent ceiling fan 300 includes: the ceiling fan comprises a ceiling fan main body 310 and an image acquisition module 320, wherein the image acquisition module is used for acquiring images of a sleeping bed; a danger processing module 330, configured to perform danger processing in combination with the sleep state if the user has a dangerous behavior; at least one processor 340 connected to the image acquisition module 320 and the hazard processing module 330, respectively; and a memory 350 communicatively coupled to the at least one processor, such as the one processor in FIG. 8.
The memory 350 stores instructions executable by the at least one processor 340 to enable the at least one processor 340 to perform the method of monitoring sleep of a user as described above with reference to fig. 2-6. The processor 340 and the memory 350 may be connected by a bus or other means, and fig. 8 illustrates a bus connection as an example.
Memory 350, which is a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as the program instructions/modules of the method of user sleep monitoring in the embodiments of the present application, for example, the various modules shown in fig. 7. The processor 340 executes various functional applications and data processing of the server by executing the nonvolatile software programs, instructions and modules stored in the memory 350, so as to implement the method for monitoring the user sleep according to the above-mentioned method embodiment.
The memory 350 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device for user sleep monitoring, and the like. Further, the memory 350 may include high speed random access memory 350, and may also include non-volatile memory 350, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 350 optionally includes memory 350 located remotely from processor 340, and such remote memory 350 may be connected to a device for user sleep monitoring over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more modules are stored in the memory 350, and when executed by the one or more processors 340, perform the method for user sleep monitoring in any of the above-described method embodiments, e.g., perform the method steps of fig. 2-6 described above, to implement the functions of the modules in fig. 7.
The product can execute the method provided by the embodiment of the application, and has the corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the methods provided in the embodiments of the present application. In addition, the intelligent ceiling fan can also perform fan cooling on the whole sleeping bed area, so that a user can sleep comfortably.
Embodiments of the present application further provide a computer program product including program code, which, when run on an electronic device, causes the electronic device to perform the method for monitoring sleep of a user in any of the above method embodiments, for example, perform the method steps of fig. 2 to fig. 6 described above, and implement the functions of the modules in fig. 7.
The embodiment of the invention has the following beneficial effects: different from the situation of the prior art, the method, the device and the intelligent ceiling fan for monitoring the sleep of the user provided by the embodiment of the invention have the advantages that the sleep state of the user lying on the sleep bed and whether dangerous behaviors exist in the user are identified by acquiring the image of the sleep bed according to the image; and if the user has dangerous behaviors, carrying out dangerous treatment by combining the sleep state. By the method, the dangerous behaviors of the user can be recognized, the guardian can be timely reminded when danger occurs, and the danger can be automatically handled, so that the danger is relieved, the safety performance is high, and the burden of the guardian is reduced.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a general hardware platform, and certainly can also be implemented by hardware. It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a computer readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; within the idea of the invention, also technical features in the above embodiments or in different embodiments may be combined, steps may be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for monitoring sleep of a user is applied to an intelligent ceiling fan, and is characterized by comprising the following steps:
collecting images of a sleeping bed;
according to the image, identifying the sleeping state of the user lying on the sleeping bed and whether dangerous behaviors exist in the user;
and if the user has dangerous behaviors, carrying out dangerous treatment by combining the sleep state.
2. The method of claim 1, wherein the sleep states include a wake-up state and a deep sleep state;
the step of performing hazard treatment in combination with the sleep state further comprises:
if the sleep state is a wake-up state, controlling the intelligent ceiling fan to output an attraction signal for absorbing the attention of a user;
and if the sleep state is a sound sleep state, sending a reminding signal to an intelligent terminal for monitoring the user.
3. The method of claim 2, further comprising:
judging whether a release condition for releasing the attraction signal is satisfied;
and if so, controlling the intelligent ceiling fan to stop outputting the suction signal.
4. The method of claim 3, wherein the release condition comprises outputting the attraction signal for a predetermined period of time or identifying that the user's dangerous behavior has been released.
5. The method according to any one of claims 2-4, wherein the attraction signal comprises a light signal or/and an audio signal.
6. The method according to any one of claims 1-4, wherein the step of identifying whether the user has dangerous behavior according to the image further comprises:
identifying whether the user is located at the edge of the sleeping bed according to the image;
if the user is located at the edge of the sleeping bed, identifying whether a guardrail exists at the edge of the sleeping bed;
if the guardrail does not exist, determining that dangerous behaviors exist in the user;
and if the guardrail exists, determining that the user does not have dangerous behaviors.
7. The method according to any one of claims 1-4, wherein the step of identifying whether the user has dangerous behavior based on the image further comprises
Recognizing the sleep posture of the user according to the image;
if the sleeping posture is a sleep-off posture, acquiring the face posture of the user;
when the facial pose is a face oriented towards the sleep bed, acquiring a duration of time that the face of the user is oriented towards the sleep bed;
judging whether the duration time is greater than preset time or not;
if so, determining that the user has dangerous behaviors;
and if not, determining that the user has no dangerous behaviors.
8. The utility model provides a device of user sleep monitoring, is applied to intelligent ceiling fan which characterized in that includes:
the image acquisition module is used for acquiring images of the sleep bed;
the recognition module is used for recognizing the sleeping state of the user lying on the sleeping bed and whether dangerous behaviors exist in the user or not according to the image;
and the processing module is used for carrying out danger processing by combining the sleep state if the user has dangerous behaviors.
9. An intelligent ceiling fan, comprising:
a ceiling fan main body;
the image acquisition module is used for acquiring images of the sleep bed;
the danger processing module is used for carrying out danger processing by combining the sleep state if the user has dangerous behaviors;
the at least one processor is respectively connected with the image acquisition module and the danger processing module; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
10. A computer program product comprising program code which, when run on an electronic device, causes the electronic device to perform the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911192837.XA CN110916614A (en) | 2019-11-28 | 2019-11-28 | User sleep monitoring method and device and intelligent ceiling fan |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911192837.XA CN110916614A (en) | 2019-11-28 | 2019-11-28 | User sleep monitoring method and device and intelligent ceiling fan |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110916614A true CN110916614A (en) | 2020-03-27 |
Family
ID=69847576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911192837.XA Pending CN110916614A (en) | 2019-11-28 | 2019-11-28 | User sleep monitoring method and device and intelligent ceiling fan |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110916614A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112184642A (en) * | 2020-09-16 | 2021-01-05 | 珠海格力电器股份有限公司 | Method and device for warning abnormal sleeping posture, storage medium and electronic device |
| CN112258788A (en) * | 2020-10-30 | 2021-01-22 | 瑞昌市兴海王子家具有限公司 | Anti-falling bed method |
| CN114811904A (en) * | 2022-04-14 | 2022-07-29 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040130449A1 (en) * | 2003-01-03 | 2004-07-08 | Hung Hung Wen | Electronic baby-soothing device with wireless remote monitor |
| CN102236781A (en) * | 2010-04-22 | 2011-11-09 | 鸿富锦精密工业（深圳）有限公司 | System and method for sensing infant sleep |
| CN104806551A (en) * | 2015-05-25 | 2015-07-29 | 广东美的环境电器制造有限公司 | Fan system, fan control system and fan control method |
| US20170206767A1 (en) * | 2015-04-21 | 2017-07-20 | Vivint, Inc. | Sleep state monitoring |
| GB2549099A (en) * | 2016-04-04 | 2017-10-11 | Connido Ltd | Monitor and system for monitoring |
| US20180035082A1 (en) * | 2016-07-28 | 2018-02-01 | Chigru Innovations (OPC) Private Limited | Infant monitoring system |
-
2019
- 2019-11-28 CN CN201911192837.XA patent/CN110916614A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040130449A1 (en) * | 2003-01-03 | 2004-07-08 | Hung Hung Wen | Electronic baby-soothing device with wireless remote monitor |
| CN102236781A (en) * | 2010-04-22 | 2011-11-09 | 鸿富锦精密工业（深圳）有限公司 | System and method for sensing infant sleep |
| US20170206767A1 (en) * | 2015-04-21 | 2017-07-20 | Vivint, Inc. | Sleep state monitoring |
| CN104806551A (en) * | 2015-05-25 | 2015-07-29 | 广东美的环境电器制造有限公司 | Fan system, fan control system and fan control method |
| GB2549099A (en) * | 2016-04-04 | 2017-10-11 | Connido Ltd | Monitor and system for monitoring |
| US20180035082A1 (en) * | 2016-07-28 | 2018-02-01 | Chigru Innovations (OPC) Private Limited | Infant monitoring system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112184642A (en) * | 2020-09-16 | 2021-01-05 | 珠海格力电器股份有限公司 | Method and device for warning abnormal sleeping posture, storage medium and electronic device |
| CN112258788A (en) * | 2020-10-30 | 2021-01-22 | 瑞昌市兴海王子家具有限公司 | Anti-falling bed method |
| CN114811904A (en) * | 2022-04-14 | 2022-07-29 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and storage medium |
| CN114811904B (en) * | 2022-04-14 | 2024-09-24 | 青岛海尔空调器有限总公司 | Method and device for controlling air conditioner, air conditioner and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230222887A1 (en) | Machine learning based monitoring system | |
| CN110916614A (en) | User sleep monitoring method and device and intelligent ceiling fan | |
| JP6717235B2 (en) | Monitoring support system and control method thereof | |
| US8743200B2 (en) | Activity monitor | |
| US20160310067A1 (en) | A baby monitoring device | |
| CN104091408A (en) | Infant sleeping posture intelligent identification method and device based on thermal infrared imaging | |
| WO2017133589A1 (en) | Safety monitoring method and device for terminal user | |
| KR102389285B1 (en) | Method for detecting a falling accident based on machine learning and system using the same | |
| CN106333557A (en) | Intelligent nursing system | |
| CN106373337A (en) | Intelligent nursing method | |
| CN108281181B (en) | Infant monitoring system and infant monitoring method | |
| CN112184642A (en) | Method and device for warning abnormal sleeping posture, storage medium and electronic device | |
| US10943137B2 (en) | Biometric data capturing and analysis | |
| CN204926413U (en) | Old person intelligent security system based on neural network and thing networking | |
| KR102367399B1 (en) | Device and method to inform the condition of infants and toddlers | |
| CN113531807A (en) | Method and device for controlling air conditioner, air conditioner and storage medium | |
| CN104063994A (en) | Warning device for identifying human consciousness based on camera | |
| KR102150623B1 (en) | Method and system for analyzing baby behavior | |
| CN112418045A (en) | Safety monitoring method and system and intelligent household appliance | |
| CN113361469A (en) | Method, device and equipment for identifying coverage state and storage medium | |
| CN111091683A (en) | Smart community child nursing early warning method and system | |
| KR20150077846A (en) | Safety monitoring system for a infant | |
| Cheggou et al. | An intelligent baby monitoring system based on raspberry PI, IoT sensors and convolutional neural network | |
| JP6822326B2 (en) | Watching support system and its control method | |
| CN106313048B (en) | The method and device of monitoring user's awake state based on intelligent robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200327 |
|
| RJ01 | Rejection of invention patent application after publication |