WO2022151887A1

WO2022151887A1 - Sleep monitoring method and related apparatus

Info

Publication number: WO2022151887A1
Application number: PCT/CN2021/137461
Authority: WO
Inventors: 韩佳
Original assignee: 华为技术有限公司
Priority date: 2021-01-15
Filing date: 2021-12-13
Publication date: 2022-07-21
Also published as: CN114762588A

Abstract

A sleep monitoring method and a related apparatus, relating to the field of artificial intelligence. In the method, a second electronic device (200) worn on a first user and used for monitoring sleep quality can determine, by means of a first electronic device (100), whether the first user has entered a sleeping state. After the first user is pre-determined to have entered the sleeping state, the second electronic device (200) sends, to the first electronic device (100), a request for determining whether the first user has entered the sleeping state. When it is determined that the first user is using the first electronic device (100), the first electronic device (100) sends, to the second electronic device (200), a message for indicating that the first user has not entered the sleeping state. The method can reduce the misjudgment, caused by using the second electronic device (200) alone for monitoring, of whether the user has entered the sleeping state, and improve the accuracy of monitoring of the time when the user enters the sleeping state.

Description

Sleep monitoring method and related device

This application claims the priority of the Chinese patent application with the application number 202110057952.7 and the application title "Sleep Monitoring Method and Related Device" filed with the China Patent Office on January 15, 2021, the entire contents of which are incorporated into this application by reference.

technical field

The present application relates to the technical field of artificial intelligence, and in particular, to a sleep monitoring method and related devices.

Background technique

The quality of sleep is closely related to people's physical health. More and more electronic devices (such as wristbands, watches, etc.) have a sleep monitoring function to monitor the quality of a person's sleep.

Sleep monitoring needs to determine whether the user has entered a sleep state and whether the user has woken up. Current electronic devices, such as wristbands, usually determine whether a user is in a sleep state by monitoring their own exercise state and the change in the user's heart rate. However, in a scenario where the user maintains a fixed posture for a long time and is not in a sleep state, the above method is likely to cause misjudgment of the sleep state. For example, in the scenario where the user uses the mobile phone in a fixed posture before going to bed, the user does not enter the sleep state. The bracelet often judges that the user has entered a sleep state, resulting in inaccurate sleep quality monitoring.

SUMMARY OF THE INVENTION

The present application provides a sleep monitoring method and a related device, which can determine whether a user enters a sleep state through the cooperation of multiple electronic devices, so as to improve the accuracy of monitoring the time when the user enters the sleep state.

In a first aspect, the present application provides a sleep monitoring method. In the method, the first electronic device may receive the first request of the second electronic device. The first electronic device has a binding relationship with the second electronic device. The first request may be sent when the second electronic device is in a wearing state and the first data is monitored. The first data is consistent with the data that the user enters the sleep state. The first electronic device may determine whether the first user wearing the second electronic device is using the first electronic device, and send the first determination result or the second determination result to the second electronic device. The first determination result is that the first user is using the first electronic device, and the second determination result is that the first user is not using the first electronic device.

The above-mentioned first electronic device can be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (personal digital assistant, PDA) and smart glasses, etc. Electronic equipment. The above-mentioned second electronic device may be an electronic device for monitoring the sleep quality of the user. For example, bracelets, watches, etc. When the second electronic device is in the wearing state, the sleep quality of the user can be monitored.

The above-mentioned first data is the data monitored when the second electronic device is worn by the first user. The above-mentioned first data may include physiological characteristic data of the first user and motion data of the second electronic device. The above-mentioned physiological characteristic data may be, for example, heart rate data. The motion data of the second electronic device may be, for example, acceleration data and angular velocity data.

The above-mentioned first data is consistent with the data that the user enters the sleep state, which may indicate that the second electronic device prejudges that the first user enters the sleep state. The above-mentioned first data may be collected through big data, and may reflect physiological characteristic data of a general user wearing the second electronic device and enter a sleep state and motion data of the second electronic device. Alternatively, the above-mentioned second data may include physiological characteristic data of the first user wearing the second electronic device and actually entering a sleep state and motion data of the second electronic device. The second electronic device can more accurately predict whether the first user enters the sleep state by using the physiological characteristic data and the motion data of the second electronic device that the first user wears the second electronic device actually enters the sleep state.

With reference to the first aspect, in some embodiments, the first electronic device may determine under the first condition that the first electronic device is being used by the user and the user is the first user, and the first electronic device obtains the first determination result. The first condition may include one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within a first time period, the first electronic device detects that a human eye is watching the first The screen of the electronic device and the first electronic device detect that it is running a screen-casting application. The first electronic device can determine under the first condition that the first electronic device is being used by the user and the user is not the first user, or the first electronic device determines that the first electronic device is not being used by the user, then the first electronic device A second judgment result is obtained.

Wherein, if the first electronic device is in a non-stationary state, the first electronic device can determine that a user is using the first electronic device. If the first electronic device monitors the user operation within the first time, the first electronic device may determine that a user is using the first electronic device. If the first electronic device detects that a human eye is looking at the screen of the first electronic device, the first electronic device may determine that a user is using the first electronic device. If the first electronic device runs a screen-casting application, the first electronic device can determine that a user is using the first electronic device.

In a possible implementation manner, when receiving the above-mentioned first request, the first electronic device may first determine whether it is in a stationary state. If the first electronic device is in a non-stationary state and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is in a stationary state, the first electronic device may further determine whether a user operation is monitored within the first time period. If the user operation is monitored within the first time period, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If no user operation is monitored within the first time period, the first electronic device may further monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.

Optionally, if it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device may further monitor whether it runs an application program for screen projection. If a screen-casting application is running, and it is determined that the user is the first user, the first electronic device can obtain the first judgment result. If it is detected that no human eye is watching the screen of the first electronic device, and no application program for screen projection is running, the first electronic device can obtain the second judgment result.

In another possible implementation manner, when receiving the above-mentioned first request, the first electronic device may first determine whether it is in a stationary state. If the first electronic device is in a non-stationary state and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is in a stationary state, the first electronic device can further monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.

In another possible implementation manner, when receiving the above-mentioned first request, the first electronic device may first determine whether a user operation is monitored within the first time period. If the user operation is monitored within the first time period, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If no user operation is monitored within the first time period, the first electronic device may further monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.

In another possible implementation manner, when receiving the above-mentioned first request, the first electronic device may monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.

In some embodiments, the first electronic device may use sensors such as an acceleration sensor, a gyroscope sensor and the like to determine whether it is in a stationary state.

In some embodiments, the above-mentioned user operation may be a touch operation acting on the screen of the first electronic device, a user operation acting on a button of the first electronic device, an input operation of a voice command, an input operation of an air gesture, and the like.

In some embodiments, the first electronic device may determine whether a human eye is looking at the screen of the first electronic device through a human eye gaze recognition model. The human eye gaze recognition model may be a neural network model. The training data for training the human eye gaze recognition model may include image data of the human eye looking at the screen and image data of the human eye not looking at the screen. The trained human eye gaze recognition model can identify the characteristics of the image in which the human eye gazes at the screen, so as to determine whether the human eye gazes at the screen of the mobile phone 100 .

In some embodiments, the method for the first electronic device to determine that the user is the first user may include: the first electronic device may determine, through the first image captured by the camera, that the first image contains the face of the first user The image is used to determine the user of the first electronic device as the first user. The above-mentioned camera for collecting the first image may be a camera of the first electronic device, or a camera of a screen projection device. The first electronic device can also determine whether the user of the first electronic device is the first user by collecting other biometric information (such as voiceprint information, fingerprint information, etc.).

With reference to the first aspect, in some embodiments, the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth. Alternatively, the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation. The first user operation may be used to indicate that the owner of the first electronic device is the first user. Alternatively, the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.

Since the first electronic device and the second electronic device have the above-mentioned binding relationship, the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.

It can be known from the above sleep monitoring method that when the second electronic device predicts that the first user enters the sleep state, the second electronic device may request the first electronic device to further confirm whether the first user enters the sleep state. The first electronic device may confirm whether the first user enters the sleep state by judging whether the first user is using the first electronic device. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.

With reference to the first aspect, in some embodiments, the first electronic device monitors a user operation to unlock the first electronic device within the second time period, and the first electronic device may send the first message to the second electronic device. The first message may be used to indicate that the first user is using the first electronic device. Alternatively, the first electronic device detects a user operation to turn off the alarm clock within the second time period, and the user who turns off the alarm clock is the first user, and the first electronic device may send the above-mentioned first message to the second electronic device.

The above unlocking method may be a method of unlocking by using biometric information. The biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like. When monitoring that the above-mentioned biometric information belongs to the biometric information of the first user, the first electronic device may determine that the unlocked user is the first user.

The above-mentioned second time period may be a time period of a first duration from when the first electronic device sends the second judgment result to the second electronic device. Alternatively, the second time period may be a preset time period.

It can be known from the above method that the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.

In a second aspect, the present application also provides a sleep monitoring method. In the method, the second electronic device monitors the first data while in the wearing state. The first data is consistent with the data that the user enters the sleep state. The second electronic device sends the first request to the first electronic device. The first electronic device has a binding relationship with the second electronic device. In the case of receiving the first judgment result from the first electronic device, the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state. The first determination result is a determination result of determining that the first user is using the first electronic device after the first electronic device receives the first request.

With reference to the second aspect, in some embodiments, after it is determined that the first user has not entered a sleep state, the second electronic device may monitor the second data while in the wearing state, and determine whether the second data and the data of the user entering the sleep state are not match. That is, the second electronic device can predict again whether the first user enters the sleep state. Wherein, after receiving the first judgment result from the first electronic device, the second electronic device may perform a pre-judgment every preset time period (such as 5 minutes, etc.), and when the pre-judgment result is that the first user enters a sleep state requesting the first electronic device to determine whether the first user enters a sleep state.

The above-mentioned second data is data of the first user, and the second data may include physiological characteristic data of the first user and motion data of the second electronic device.

With reference to the second aspect, in some embodiments, after determining that the first user is not in a sleep state, the second electronic device may record the monitored physiological characteristic data of the user as data not in a sleep state.

With reference to the second aspect, in some embodiments, in the case of receiving the second determination result from the first electronic device, the second electronic device determines that the first user enters a sleep state. The second determination result is the determination result that the first electronic device determines that the first user does not use the first electronic device after receiving the first request.

Further, after it is determined that the first user enters the sleep state, the second electronic device may record the monitored physiological characteristic data of the user as data in the sleep state.

With reference to the second aspect, in some embodiments, the second electronic device receives the first message from the first electronic device when detecting that the state of the first user is the sleep state, and can determine the first message detected by the second electronic device The user's state is a non-sleep state. The first message may be used to indicate that the first user is using the first electronic device.

In a third aspect, the present application also provides a sleep monitoring method. In the method, the second electronic device monitors the first data while in the wearing state. The first data is consistent with the data that the user enters the sleep state. The second electronic device may send the first request to the first electronic device. The first electronic device has a binding relationship with the second electronic device. The first electronic device receives the first request from the second electronic device. The first electronic device may determine whether the first user wearing the second electronic device is using the first electronic device, and send the first determination result or the second determination result to the second electronic device. The first determination result is that the first user is using the first electronic device. The second judgment result is that the first user does not use the first electronic device. In the case of receiving the first judgment result, the second electronic device may determine that the first user does not enter the sleep state.

With reference to the third aspect, in some embodiments, the first electronic device determines under the first condition that the first electronic device is being used by the user and the user is the first user, and the first electronic device obtains the first determination result. The first condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within the first time period, and the first electronic device detects that a human eye is watching the first electronic device. The screen of the device and the first electronic device detect that it is running a screen-casting application. Under the first condition, the first electronic device determines that the first electronic device is being used by the user and the user is not the first user, or the first electronic device determines that the first electronic device is not being used by the user, and the first electronic device obtains the first electronic device. 2. Judgment results.

With reference to the third aspect, in some embodiments, the method for the first electronic device to determine that the user is the first user may be: the first electronic device captures the first image through a camera, and determines that the first image contains the first user face image. The above-mentioned camera for collecting the first image may be a camera of the first electronic device, or a camera of a screen projection device. The first electronic device can also determine whether the user of the first electronic device is the first user by collecting other biometric information (such as voiceprint information, fingerprint information, etc.).

With reference to the third aspect, in some embodiments, in the case of receiving the second judgment result, the second electronic device may determine that the first user enters a sleep state.

With reference to the third aspect, in some embodiments, the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth. Alternatively, the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation. The first user operation may be used to indicate that the owner of the first electronic device is the first user. Alternatively, the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.

With reference to the third aspect, in some embodiments, the first electronic device monitors a user operation of unlocking the first electronic device within the second time period, and the first electronic device may send the first message to the second electronic device. The first message may be used to indicate that the first user is using the first electronic device. Alternatively, the first electronic device detects a user operation to turn off the alarm clock within the second time period, and the user who turns off the alarm clock is the first user, and the first electronic device may send the first message to the second electronic device.

The above unlocking method may be a method of unlocking by using biometric information. The biometric information can be, for example, face information, voiceprint information, fingerprint information, and the like. When monitoring that the above-mentioned biometric information belongs to the biometric information of the first user, the first electronic device may determine that the unlocked user is the first user.

In a fourth aspect, the present application also provides a sleep monitoring method. In this method, the second electronic device receives the first message of the first electronic device when detecting that the state of the first user wearing the second electronic device is a sleep state, and can determine the first message detected by the second electronic device The user's state is a non-sleep state. The first electronic device has a binding relationship with the second electronic device. The first message may be sent by the first electronic device after monitoring the user operation of unlocking the first electronic device within the first monitoring time period.

When the second electronic device receives the first message, determining that the detected state of the first user is a non-sleep state may specifically be marking the detected state of the first user from a sleep state to a non-sleep state. That is to say, when receiving the above-mentioned first message, the second electronic device may determine that the first user wakes up. Furthermore, the second electronic device may determine the moment when the first message is received or the moment when the first electronic device detects the unlocking user operation as the moment when the first user wakes up.

With reference to the fourth aspect, in some embodiments, the above unlocking method may be a method for unlocking by using biometric information. The biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like. When monitoring that the above-mentioned biometric information belongs to the biometric information of the first user, the first electronic device may determine that the unlocked user is the first user.

In conjunction with the fourth aspect, in some embodiments, the second electronic device monitors the first data while in the wearing state. The first data is consistent with the data that the user enters the sleep state. The second electronic device may send the first request to the first electronic device. The second electronic device receives the judgment result that the first electronic device indicates that the first user does not use the first electronic device, and can determine that the state of the first user detected by the second electronic device is the sleep state.

With reference to the fourth aspect, in some embodiments, the above-mentioned first monitoring time period may be a time period for which the second electronic device estimates the first user to exit the sleep state. Optionally, the above-mentioned first monitoring time period may be a fixed time period, such as a time period from 5:00 am to the above-mentioned 10:00 am.

With reference to the fourth aspect, in some embodiments, the above-mentioned first monitoring period may be the first period of time from the first electronic device sending a judgment result indicating that the first user does not use the first electronic device to the second electronic device part.

The above-mentioned first monitoring time period and the second time period in the foregoing embodiment may be the same time period.

With reference to the fourth aspect, in some embodiments, the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth. Alternatively, the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation. The first user operation may be used to indicate that the owner of the first electronic device is the first user. Alternatively, the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.

With reference to the fourth aspect, in some embodiments, after determining that the detected state of the first user is a non-sleep state, the second electronic device may further record the monitored physiological characteristic data of the user as not in a sleep state data.

In a fifth aspect, the present application also provides a sleep monitoring method. In this method, the first electronic device may monitor the user operation of unlocking the first electronic device within the first monitoring time period, and send the first message to the second electronic device. The first message is used to indicate that the first user wearing the second electronic device is using the first electronic device. The first electronic device has a binding relationship with the second electronic device. The second electronic device receives the first message when detecting that the state of the first user is a sleep state, and may determine that the detected state of the first user is a non-sleep state.

With reference to the fifth aspect, in some embodiments, the second electronic device monitors the first data when it is in the wearing state, and the first data is consistent with the data that the user enters the sleep state. The second electronic device sends the first request to the first electronic device. The first electronic device receives the first request, determines whether the first user is using the first electronic device, and obtains a determination result indicating that the first user is not using the first electronic device. The first electronic device may send a judgment result indicating that the first user does not use the first electronic device to the second electronic device. When receiving the above determination result indicating that the first user does not use the first electronic device, the second electronic device may determine that the first user enters a sleep state.

With reference to the fifth aspect, in some embodiments, the above-mentioned first monitoring time period may be a time period during which the second electronic device estimates the first user to exit the sleep state.

With reference to the fifth aspect, in some embodiments, the above-mentioned first monitoring time period may be the first time period from the time when the first electronic device sends a judgment result indicating that the first user does not use the first electronic device to the second electronic device part.

With reference to the fifth aspect, in some embodiments, before sending the above-mentioned first message to the second electronic device, the first electronic device may further determine under the first condition that the first electronic device is being used by the user and the user is the first electronic device a user. The first condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within the first time period, and the first electronic device detects that a human eye is watching the first electronic device. The screen of the device and the first electronic device detect that it is running a screen-casting application.

With reference to the fifth aspect, in some embodiments, when it is determined that the first user exits the sleep state, the second electronic device may record the monitored physiological characteristic data of the user as data not in the sleep state.

With reference to the fifth aspect, in some embodiments, the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth. Alternatively, the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation. The first user operation may be used to indicate that the owner of the first electronic device is the first user. Alternatively, the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.

In a sixth aspect, the present application provides an electronic device. The electronic device is a first electronic device. The first electronic device may include a camera, a communication module, a memory and a processor. A camera can be used to capture images. The communication module can be used to establish a communication connection with the second electronic device. Memory can be used to store computer programs. The processor may be configured to invoke a computer program, so that the first electronic device executes any of the possible implementation methods of the above-mentioned first aspect.

In a seventh aspect, the present application further provides an electronic device. The electronic device is the second electronic device. The second electronic device may include a communication module, a memory and a processor. The communication module can be used to establish a communication connection with the first electronic device. Memory can be used to store computer programs. The processor may be configured to invoke a computer program, so that the second electronic device executes any possible implementation method of the second aspect above or any possible implementation method of the fourth aspect above.

In an eighth aspect, the present application provides a sleep monitoring system, which may include the electronic device provided in the sixth aspect and the electronic device provided in the seventh aspect.

In a ninth aspect, an embodiment of the present application provides a chip, which is applied to the electronic device provided in the sixth aspect or the electronic device provided in the seventh aspect, the chip includes one or more processors, and the processors are used to invoke computer instructions In order to make the electronic device provided in the sixth aspect above perform any possible implementation method as in the first aspect, or cause the electronic device provided in the seventh aspect above to perform any possible implementation method as in the second aspect or perform as in the fourth aspect Any possible implementation of the aspect.

In a tenth aspect, an embodiment of the present application provides a computer program product containing instructions, when the computer program product is executed on an electronic device, the electronic device provided in the sixth aspect can perform any possible implementation as in the first aspect. method, or cause the electronic device provided in the seventh aspect to perform any possible implementation method as in the second aspect or perform any possible implementation method as in the fourth aspect.

In an eleventh aspect, an embodiment of the present application provides a computer storage medium, including computer instructions, when the computer instructions are executed on an electronic device, the electronic device provided in the sixth aspect can execute any of the possible operations in the first aspect. The implementation method is implemented, or the electronic device provided in the seventh aspect is caused to perform any possible implementation method in the second aspect or any possible implementation method in the fourth aspect.

It can be understood that the electronic device provided in the sixth aspect, the electronic device provided in the seventh aspect, the sleep monitoring system provided in the eighth aspect, the chip provided in the ninth aspect, the computer program product provided in the tenth aspect, and the eleventh aspect The provided computer-readable storage media are all used to execute the methods provided by the embodiments of the present application. Therefore, for the beneficial effects that can be achieved, reference may be made to the beneficial effects in the corresponding method, which will not be repeated here.

Description of drawings

FIG. 1 is a schematic structural diagram of a first electronic device 100 provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of a sleep monitoring scenario provided by an embodiment of the present application;

3 is a flowchart of a sleep monitoring method provided by an embodiment of the present application;

4 is a flowchart of another sleep monitoring method provided by an embodiment of the present application;

5 is a flowchart of another sleep monitoring method provided by an embodiment of the present application;

FIG. 6 is a flowchart of another sleep monitoring method provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described clearly and in detail below with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, unless otherwise specified, “/” means or, for example, A/B can mean A or B; “and/or” in the text is only a description of an associated object The association relationship indicates that there can be three kinds of relationships, for example, A and/or B can indicate that A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of this application , "plurality" means two or more than two.

Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and should not be understood as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the "multiple" The meaning is two or more.

The present application provides a sleep monitoring method, which can monitor whether a user enters a sleep state through the cooperation of a first electronic device and a second electronic device. Sleep state can refer to the form that a person exhibits when sleeping. The sleep state may include a sleep onset stage, a light sleep stage, and a deep sleep stage. A user in a sleeping state maintains a fixed posture for a long time or has a small change in the posture of the limbs. Also, the heart rate of the user in the sleeping state fluctuates around the resting heart rate. The first electronic device may be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and smart glasses. equipment. The second electronic device is an electronic device for monitoring the user's sleep quality. The sleep quality monitoring may include determining the total duration of the user in a sleep state, and data such as the duration of sleep onset, light sleep, and deep sleep in the sleep state. The second electronic device may be, for example, an electronic device such as a wristband, a watch, or the like. That is, the user can monitor his own sleep quality by wearing the second electronic device. The embodiments of the present application do not limit the specific types of the first electronic device and the second electronic device.

In the sleep monitoring method, the second electronic device is worn on the first user. A sleep model is stored in the second electronic device. The second electronic device may use a sleep model to predict whether the first user enters a sleep state according to data collected by sensors such as an acceleration sensor and a heart rate sensor. When the pre-judgment result of the second electronic device is that the first user enters the sleep state, the second electronic device may send a request for confirming whether the first user enters the sleep state to the first electronic device. Further, the first electronic device can detect whether the first user is using the first electronic device. If it is determined that the first user is using the first electronic device, the first electronic device may notify the second electronic device that the first user is using the first electronic device. The second electronic device may determine that the first user has not entered a sleep state according to the notification. Otherwise, the first electronic device may notify the second electronic device that the first electronic device is not used by the first user. The second electronic device may determine that the second user enters the sleep state according to the notification.

It can be known from the above method that when the second electronic device predicts that the first user enters the sleep state, the second electronic device can request the first electronic device to further confirm whether the first user enters the sleep state. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.

FIG. 1 exemplarily shows a schematic structural diagram of a first electronic device 100 provided by an embodiment of the present application.

As shown in FIG. 1 , the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, Battery 142, Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Jack 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, A camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the first electronic device 100 . In other embodiments of the present application, the first electronic device 100 may include more or less components than shown, or some components are combined, or some components are separated, or different components are arranged. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The controller may be the nerve center and command center of the first electronic device 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.

The USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the first electronic device 100, and can also be used to transmit data between the first electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices.

The charging management module 140 is used to receive charging input from the charger.

The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140 and supplies power to the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .

The wireless communication function of the first electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 may be used to cover a single or multiple communication frequency bands.

The mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the first electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .

The wireless communication module 160 can provide applications on the first electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global Navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In some embodiments, the antenna 1 of the first electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the first electronic device 100 can communicate with the network and other devices through wireless communication technology.

The first electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

Display screen 194 is used to display images, videos, and the like. In some embodiments, the first electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

The first electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process the data fed back by the camera 193 . For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193 .

Camera 193 is used to capture still images or video. The object is projected through the lens to generate an optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the first electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.

A digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the first electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point, and the like.

Video codecs are used to compress or decompress digital video. The first electronic device 100 may support one or more video codecs. In this way, the first electronic device 100 can play or record videos in various encoding formats, such as: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.

The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process the input information, and can continuously learn by itself. Applications such as intelligent cognition of the first electronic device 100 can be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the first electronic device 100.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the first electronic device 100 by executing the instructions stored in the internal memory 121 . The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area may store data (such as audio data, phone book, etc.) created during the use of the first electronic device 100 and the like.

The first electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.

The audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals.

Speaker 170A, also referred to as a "speaker", is used to convert audio electrical signals into sound signals.

The receiver 170B, also referred to as "earpiece", is used to convert audio electrical signals into sound signals.

The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

The earphone jack 170D is used to connect wired earphones.

The pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be provided on the display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The first electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the first electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The first electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the motion attitude of the first electronic device 100 . In some embodiments, the angular velocity of the first electronic device 100 about three axes (ie, the x, y and z axes) may be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shaking angle of the first electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to offset the shaking of the first electronic device 100 through reverse motion, Achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenarios.

The air pressure sensor 180C is used to measure air pressure.

The magnetic sensor 180D includes a Hall sensor.

The acceleration sensor 180E can detect the magnitude of the acceleration of the first electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the first electronic device 100 is stationary. It can also be used for recognizing the posture of the first electronic device 100, and can be used in applications such as switching between horizontal and vertical screens, and pedometers.

Distance sensor 180F for measuring distance.

Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The first electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object near the first electronic device 100 . When insufficient reflected light is detected, the first electronic device 100 may determine that there is no object near the first electronic device 100 .

The ambient light sensor 180L is used to sense ambient light brightness. The first electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the first electronic device 100 is in the pocket, so as to prevent accidental touch.

The fingerprint sensor 180H is used to collect fingerprints. The first electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.

The temperature sensor 180J is used to detect the temperature.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the first electronic device 100 , which is different from the position where the display screen 194 is located.

The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the pulse of the human body and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone, combined with the bone conduction earphone. The audio module 170 can analyze the voice signal based on the vibration signal of the vocal vibration bone block obtained by the bone conduction sensor 180M, and realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M, and realize the function of heart rate detection.

The keys 190 include a power-on key, a volume key, and the like. The first electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the first electronic device 100 .

Motor 191 can generate vibrating cues.

The indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact with and separation from the first electronic device 100 . The first electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. In some embodiments, the first electronic device 100 employs an eSIM, ie an embedded SIM card. The eSIM card can be embedded in the first electronic device 100 and cannot be separated from the first electronic device 100 .

For the structure of the second electronic device 200 , reference may be made to the schematic structural diagram of the first electronic device 100 shown in FIG. 1 , which is not repeated in this embodiment of the present application.

In the subsequent embodiments of the present application, the sleep monitoring method provided by the present application is specifically introduced by taking the first electronic device 100 as a mobile phone and the second electronic device 200 as a wristband.

FIG. 2 exemplarily shows a sleep monitoring scenario involved in the present application.

As shown in FIG. 2 , the first user wears the bracelet 200 . The first user uses the mobile phone 100 while lying on the bed and maintaining a fixed posture. The bracelet 200 can use a sleep model to predict that the first user has entered a sleep state according to data collected by sensors such as an acceleration sensor and a heart rate sensor. The bracelet 200 may request the mobile phone 100 to further confirm whether the first user enters the sleep state. The mobile phone 100 can confirm whether the first user enters the sleep state by judging whether the first user is using the mobile phone 100 . If it is determined that the first user is using the mobile phone 100 , the mobile phone 100 may send a message to the bracelet 200 to indicate that the first user is using the mobile phone 100 . When receiving the message, the bracelet 200 may determine that the first user has not entered a sleep state. If it is determined that the first user does not use the mobile phone 100 , the mobile phone 100 may send a message to the bracelet, indicating that the first user does not use the mobile phone 100 . When receiving the message, the bracelet 200 can determine that the first user has entered a sleep state.

The mobile phone 100 can determine whether the first user uses the mobile phone by monitoring whether the mobile phone 100 is in a stationary state, whether it detects user operations acting on the mobile phone 100 within a preset time, and whether the first user's eyes are looking at the screen of the mobile phone 100 100.

Exemplarily, the mobile phone 100 can determine whether it is in a stationary state by using the data collected by the acceleration sensor and the gyroscope sensor. If it is determined that it is in a non-stationary state (that is, the posture of the mobile phone 100 changes), the mobile phone 100 can determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user using the mobile phone 100 is the first user.

If it is determined that the mobile phone 100 is in a stationary state, the mobile phone 100 can monitor whether there is a user operation acting on the mobile phone 100 within a preset time. This can reduce the misjudgment of whether the user is in a sleep state when the mobile phone 100 is in a stationary state but is still being used by the user. If the user operation is monitored within the preset time, the mobile phone 100 may determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user using the mobile phone 100 is the first user. This embodiment of the present application does not limit the length of the foregoing preset time.

If no user operation is detected within the preset time, the mobile phone 100 can monitor whether human eyes are watching the screen of the mobile phone 100 . This can reduce the misjudgment of whether the user is in a sleep state when the mobile phone is in a stationary state and there is no user operation for a preset period of time, but is still used by the user (for example, a scene where the mobile phone is in a stationary state to play a video). If a human eye looks at the screen of the mobile phone 100, the mobile phone 100 can determine whether the user looking at the screen is the first user. If no human eyes look at the screen of the mobile phone 100 or the user looking at the screen of the mobile phone 100 is not the first user, the mobile phone 100 can determine that the first user does not use the mobile phone 100 .

The above-mentioned implementation method of the bracelet 200 using the sleep model to predict whether the first user enters the sleep state, and the implementation method of the mobile phone 100 to determine whether the user using the mobile phone 100 is the first user will be described in detail in the subsequent embodiments, and will not be described here first. .

In this embodiment of the present application, the mobile phone 100 and the bracelet 200 have a binding relationship.

In a possible implementation manner, the mobile phone 100 and the bracelet 200 may establish a binding relationship through Bluetooth pairing. The mobile phone 100 may mark the bracelet 200 as a receiving bracelet worn by the owner of the mobile phone 100 . For example, the mobile phone 100 may add an owner tag to the bracelet 200 when storing the Bluetooth address of the bracelet 200 . When receiving a request from the bracelet 200 for determining whether the first user enters a sleep state, the mobile phone 100 can detect whether the first user is using the mobile phone 100 . When receiving a request sent by a bracelet without an owner tag for determining whether the user enters a sleep state, the mobile phone 100 may not process the request.

In another possible implementation manner, in response to the first user operation, the mobile phone 100 may establish a binding relationship with the bracelet 200 . The first user operation may be used to indicate that the owner of the mobile phone 100 and the user wearing the bracelet 200 are the same user. Specifically, the mobile phone 100 can manage the bracelets that have established a communication connection with itself. The setting options for managing the bracelet in the mobile phone 100 may include a sleep assist function. In response to the above-mentioned first user operation, the mobile phone 100 can enable the sleep assist function in the setting options for managing the bracelet 200 . When the above sleep assist function is enabled, the bracelet 200 may request the mobile phone 100 to further confirm whether the owner of the mobile phone 100 is in the sleep state after prejudging that the user wearing the bracelet 200 has entered the sleep state.

In another possible implementation manner, the mobile phone 100 and the bracelet 200 may establish a binding relationship by associating with the same account (for example, a Huawei account). That is, the accounts logged in the mobile phone 100 and the bracelet 200 are the same account. Since the mobile phone 100 and the bracelet 200 have a binding relationship, the mobile phone 100 can assist the bracelet 200 to monitor whether the user wearing the bracelet 200 (ie the first user) has entered by judging whether the owner (ie, the first user) is using the mobile phone. sleep state. This can reduce the misjudgment that the user of the mobile phone 100 and the user wearing the bracelet 200 are not the same person as to whether the user enters the sleep state.

The embodiments of the present application do not limit the manner in which the mobile phone 100 and the bracelet 200 establish a binding relationship.

Since the present application relates to the application of neural networks, for ease of understanding, the following describes terms related to neural networks that may be involved in the embodiments of the present application.

1. Neural network

A neural network can be composed of neural units, and a neural unit can refer to an operation unit that takes x _s and an intercept 1 as inputs, and the output of the operation unit can refer to the following formula (1):

Among them, s=1, 2, ..., n, n is a natural number greater than 1, W _s is the weight of x _s , and b is the bias of the neural unit. f is an activation function of the neural unit, which is used to introduce nonlinear characteristics into the neural network to convert the input signal in the neural unit into an output signal. The output signal of this activation function can be used as the input of the next convolutional layer. The activation function can be a sigmoid function. A neural network is a network formed by connecting many of the above single neural units together, that is, the output of one neural unit can be the input of another neural unit. The input of each neural unit can be connected with the local receptive field of the previous layer to extract the features of the local receptive field, and the local receptive field can be an area composed of several neural units.

2. Loss function

In the process of training the neural network, because it is hoped that the output of the neural network is as close as possible to the value that you really want to predict, you can compare the predicted value of the current network with the target value you really want, and then based on the difference between the two to update the weight vector of each layer of the neural network (of course, there is usually an initialization process before the first update, that is, to pre-configure parameters for each layer in the neural network), for example, if the predicted value of the network is high, Just adjust the weight vector to make its prediction lower, and keep adjusting until the neural network can predict the real desired target value or a value that is very close to the real desired target value. Therefore, it is necessary to pre-define "how to compare the difference between the predicted value and the target value", which is the loss function (loss function) or objective function (objective function), which are used to measure the difference between the predicted value and the target value. important equation. Among them, taking the loss function as an example, the higher the output value of the loss function (loss), the greater the difference, then the training of the neural network becomes the process of reducing the loss as much as possible.

3. Back propagation algorithm

The convolutional neural network can use the error back propagation (BP) algorithm to correct the size of the parameters in the initial super-resolution model during the training process, so that the reconstruction error loss of the super-resolution model becomes smaller and smaller. Specifically, forwarding the input signal until the output will generate an error loss, and updating the parameters in the initial super-resolution model by back-propagating the error loss information, so that the error loss converges. The back-propagation algorithm is a back-propagation motion dominated by the error loss, aiming to obtain the parameters of the optimal super-resolution model, such as the weight matrix.

The following specifically describes a sleep monitoring method provided by an embodiment of the present application.

FIG. 3 exemplarily shows a flowchart of a sleep monitoring method provided by an embodiment of the present application. As shown in FIG. 3, the method may include steps S101-S108. in:

S101. The bracelet 200 uses a sleep model to predict that the first user enters a sleep state.

The sleep model may be a trained neural network model.

In some embodiments, the bracelet 200 can collect acceleration data in real time through an acceleration sensor, and collect heart rate data of the first user through a heart rate sensor in real time. Based on the above acceleration data and heart rate data, the bracelet 200 can use the sleep model to predict whether the first user enters a sleep state. Wherein, when the user is in a sleep state, the wristband 200 usually has a small change in posture within a certain period of time, or even the posture remains unchanged. The posture of the wristband 200 is different when the wristband 200 is worn on the user and remains in a stationary state and when the wristband 200 is placed on a desktop and remains in a stationary state. Also, the heart rate usually drops gradually after the user goes to sleep. Therefore, in combination with the acceleration data and the heart rate data detected by the bracelet 200, the bracelet 200 can predict whether the user enters a sleep state.

The training data for training the sleep model may include acceleration data and heart rate data of the bracelet 200 when the user is actually in a sleeping state, and acceleration data and heart rate data of the bracelet 200 when the user is actually in a non-sleep state. These data can be collected through big data. That is, these data may be acceleration data and heart rate data in a sleep state and acceleration data and heart rate data in a non-sleep state when a general user wears the bracelet 200 . Alternatively, these data may be acceleration data and heart rate data in a sleep state and acceleration data and heart rate data in a non-sleep state when the first user is wearing the bracelet 200 . The sleep model trained by using the data of the first user can better predict whether the first user enters a sleep state.

The trained sleep model can identify the characteristics of the acceleration data and heart rate data of the bracelet 200 when the first user is actually in a sleeping state, so as to predict whether the first user is in a sleeping state. That is to say, when the acceleration data monitored by the wristband 200 is consistent with the acceleration data when the user is actually sleeping, and the monitored heart rate data is consistent with the heart rate data when the user is actually sleeping, the wristband 200 It can be predicted that the first user enters a sleep state.

In some embodiments, the bracelet 200 can also use a sleep model to predict whether the first user is sleeping based on data such as angular velocity data collected by a gyro sensor, ambient light data collected by an ambient light sensor, and ambient sound data collected by a microphone. state. That is, the training data of the sleep model may also include angular velocity data, ambient light data, ambient sound data, and the like.

The embodiments of the present application do not limit the training data used for training the sleep model and the method for training the sleep model. For the method for the wristband 200 to predict whether the first user enters the sleep state, reference may also be made to the method for judging whether the first user enters the sleep state by electronic devices such as wristbands in the prior art.

S102 , the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user is in a sleep state.

S103, the mobile phone 100 determines whether it is in a stationary state.

The fact that the mobile phone 100 is in a non-stationary state can indicate that a user is using the mobile phone 100 . The fact that the mobile phone 100 is in a stationary state cannot directly indicate that no user is using the mobile phone 100 . For example, in a scenario where the user places the mobile phone 100 on the mobile phone stand to use the mobile phone 100, the mobile phone 100 is in a stationary state, but is still used by the user.

When receiving a request from the bracelet 200 for confirming whether the first user is in a sleep state, the mobile phone 100 can determine whether it is in a stationary state through acceleration data collected by the acceleration sensor.

If it is determined that it is in a stationary state, the mobile phone 100 may perform the following step S104.

If it is determined that it is in a non-stationary state, the mobile phone 100 may perform the following step S106.

The method for determining whether the mobile phone 100 is in a stationary state in this embodiment of the present application is not limited. For example, the mobile phone 100 can also determine whether it is in a stationary state through the angular velocity data collected by the gyro sensor.

The mobile phone 100 monitors whether the first user is in a sleep state by judging whether it is in a stationary state, which can reduce the misjudgment of whether the first user is in a sleep state when the mobile phone 100 is in a stationary state but is still used by the first user.

S104, the mobile phone 100 determines whether a user operation is monitored within a preset time.

The fact that the mobile phone 100 monitors the user operation within the preset time can indicate that a user is using the mobile phone 100 . The fact that the mobile phone 100 does not monitor the user operation within the preset time cannot directly indicate that no user is using the mobile phone 100 . For example, the length of the above-mentioned preset time is 10 minutes. In a scenario where the user places the mobile phone 100 on the mobile phone stand to watch a video for 30 minutes, the mobile phone 100 may not receive user operation during the video playback process, but is still blocked by the user. use.

The above-mentioned user operation may be, for example, a touch operation acting on the screen of the mobile phone 100, a user operation acting on a button of the mobile phone 100, an input operation of a voice command, an input operation of an air gesture, and the like. This embodiment of the present application does not limit the specific types of the above-mentioned user operations.

If no user operation is detected within the preset time, the mobile phone 100 may perform the following step S105.

If the user operation is monitored within the preset time, the mobile phone 100 may perform the following step S106.

This embodiment of the present application does not limit the length of the foregoing preset time.

When the mobile phone 100 is in a stationary state, the mobile phone 100 monitors whether the first user enters a sleep state by judging whether a user operation is monitored within a preset time, which can reduce the number of times that the mobile phone 100 is in a stationary state and there is no user operation within the preset time. However, a scene still being used by the first user (eg, a scene where the mobile phone is in a still state to play a video) misjudged whether the first user has entered a sleep state.

S105. The mobile phone 100 determines whether human eyes are watching the screen.

The mobile phone 100 can capture images through the front camera. Based on the above image, the mobile phone 100 can use the human eye gaze recognition model to determine whether the human eye gazes at the screen.

The human eye gaze recognition model may be a neural network model.

The training data for training the human eye gaze recognition model may include image data of the human eye looking at the screen and image data of the human eye not looking at the screen. The trained human eye gaze recognition model can identify the characteristics of the image in which the human eye gazes at the screen, so as to determine whether the human eye gazes at the screen of the mobile phone 100 . For the method of training the human eye gaze recognition model, reference may be made to the training method of the neural network model in the prior art, which will not be repeated in this application.

In some embodiments, the aforementioned front-facing camera for capturing images may be a low-power camera. For example, infrared cameras. The above-mentioned low-power camera can be in a working state in real time. This embodiment of the present application does not limit the type of the above-mentioned front camera.

In some embodiments, when it is determined that there is no user operation acting on the mobile phone 100 within a preset time period, the mobile phone 100 can turn on the above-mentioned front camera to capture images. Alternatively, when receiving a request from the bracelet 200 for confirming whether the first user has entered a sleep state, the mobile phone 100 may turn on the aforementioned front-facing camera. The embodiment of the present application does not limit the time when the mobile phone 100 turns on the front camera.

If it is recognized that human eyes are watching the screen, the mobile phone 100 may perform the following step S106.

If it is recognized that no human eye is watching the screen, the mobile phone 100 may perform the following step S108.

The mobile phone 100 monitors whether the first user is in a sleep state by judging whether human eyes are watching the screen, which can reduce the situation where the mobile phone 100 is in a stationary state, and there is no user operation within a preset time, but is not used by the first user (for example, the mobile phone is in a stationary state. The video is played in the state, but the first user falls asleep during the video playback) misjudgment of whether the first user has entered the sleep state.

S106, the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.

In any of the following situations: the mobile phone 100 determines that the mobile phone 100 is in a non-stationary state, the mobile phone 100 determines that the mobile phone 100 is in a stationary state but monitors user operations within a preset time, and the mobile phone 100 determines that the mobile phone 100 is in a stationary state and is in a stationary state. If no user operation is detected within the preset time, but it is recognized that someone is watching the screen of the mobile phone 100 , the mobile phone 100 can determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user is the first user.

In a possible implementation manner, the mobile phone 100 may determine whether the user is the first user through face recognition.

Wherein, there is a binding relationship between the bracelet 200 and the mobile phone 100 . The first user wearing the bracelet 200 is the owner of the mobile phone 100 . The mobile phone 100 can compare the face image collected by the front camera with the face image of the owner stored in the mobile phone 100 to determine whether the user of the mobile phone 100 is the first user. The above-mentioned face image of the owner stored in the mobile phone 100 may be a face image used for face recognition to unlock the mobile phone 100 . The embodiment of the present application does not limit the method for the mobile phone 100 to compare whether the face image collected by the front camera and the face image of the owner stored in the mobile phone 100 are the face image of the same user.

Optionally, the mobile phone 100 may also determine whether the user of the mobile phone 100 is the first user by means of biometric identification methods such as voiceprint recognition and fingerprint recognition. This embodiment of the present application does not limit the specific method for determining whether the user of the mobile phone 100 is the first user.

If it is determined that the user of the mobile phone 100 is the first user, the mobile phone 100 may execute the following step S107.

If it is determined that the user of the mobile phone 100 is not the first user, the mobile phone 100 may execute the following step S108.

When it is determined that the mobile phone 100 is used by the user, the mobile phone 100 detects whether the first user enters the sleep state by identifying whether the user is the first user, which can reduce the number of users of the mobile phone 100 and the first user wearing the bracelet 200 It is not the same person's misjudgment of whether the first user has entered a sleep state.

S107 , the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .

If it is determined that the mobile phone 100 is used by the user and the user is the first user, the mobile phone 100 can determine that the first user is using the mobile phone 100 . Then, the mobile phone 100 may send the first judgment result to the bracelet 200 to indicate that the first user is using the mobile phone 100 .

In some embodiments, after receiving the first judgment result from the mobile phone 100, the bracelet 200 can use the sleep model again to predict whether the first user enters the sleep state, and request the mobile phone 100 to confirm whether the first user enters the sleep state . Wherein, when it is determined that the first user is in a sleep state, the bracelet 200 can use a sleep model to predict whether the first user is in a sleep state every preset time period (eg, 5 minutes, etc.).

In some embodiments, after receiving the first judgment result from the mobile phone 100, the bracelet 200 may record the monitored data (such as heart rate data) as the data that the first user is in a non-sleep state.

S108 , the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .

If it is determined that no human eye is watching the screen of the mobile phone 100 , or it is determined that the mobile phone 100 is used by the user but the user is not the first user, the mobile phone 100 may determine that the first user does not use the mobile phone 100 . Then, the mobile phone 100 can send the second judgment result to the bracelet 200, indicating that the first user does not use the mobile phone 100.

When receiving the second judgment result from the mobile phone 100, the bracelet 200 may determine the moment when the second judgment result is received as the moment when the first user enters the sleep state. Alternatively, the bracelet 200 may predetermine the moment when the first user enters the sleep state as the moment when the first user enters the sleep state. In this embodiment of the present application, the time when the wristband 200 determines that the first user enters the sleep state is not particularly limited. The bracelet 200 may record the monitored data (such as heart rate data) after the first user enters the sleep state as the data when the first user is in the sleep state.

It can be known from the sleep monitoring method shown in FIG. 3 that the bracelet 200 can use the mobile phone 100 to confirm whether the first user enters the sleep state. This can reduce the misjudgment of whether the first user has entered the sleep state because the first user maintains a fixed posture for a long time but is not in the sleep state when the bracelet 200 is used alone to monitor whether the first user has entered the sleep state, and the first user can be improved. The accuracy of monitoring when the user goes to sleep. Thus, the bracelet 200 can improve the accuracy of sleep quality monitoring.

In addition, after determining that the mobile phone 100 is in a non-stationary state, it can directly determine whether the user of the mobile phone 100 is the first user. In this way, the mobile phone 100 does not need to perform steps S104 and S105 , thereby saving the power consumption of the mobile phone 100 . After the mobile phone 100 determines that the user's operation has not been monitored within the preset time, it can directly determine whether the user of the mobile phone 100 is the first user. In this way, the mobile phone 100 does not need to perform step S105 , thereby saving the power consumption of the mobile phone 100 .

In some embodiments, the execution order of the above steps S103 and S104 may be reversed. That is, after receiving the request from the bracelet 200 for confirming whether the first user enters the sleep state, the mobile phone 100 may first determine whether there is a user operation within the preset time. If it is determined that there is a user operation within the preset time, the mobile phone 100 may perform step S106. If it is determined that there is no user operation within the preset time, the mobile phone 100 can further determine whether it is in a stationary state. If it is determined that it is in a stationary state, the mobile phone 100 may execute step S105. If it is determined that it is in a non-stationary state, the mobile phone 100 may execute step S106.

In some other embodiments, after receiving a request from the bracelet 200 for confirming whether the first user is in a sleep state, the mobile phone 100 can simultaneously execute the above steps S103, S104, and S105 to determine whether the mobile phone 100 is in the sleep state. used by users. If it is determined that the mobile phone 100 is used by the user, the mobile phone 100 may further perform step S106 to determine whether the user is the first user. Otherwise, the mobile phone 100 may execute step S108 to instruct the first user of the bracelet 200 to enter the sleep state.

FIG. 4 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.

As shown in FIG. 4, the method may include steps S201-S207. in:

S201. The bracelet 200 uses the sleep model to predict that the first user enters the sleep state.

S202 , the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user enters the sleep state.

The above steps S201 and S202 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.

S203, the mobile phone 100 determines whether it is in a stationary state.

For the method for determining whether the mobile phone 100 is in a stationary state, reference may be made to step S203 in the method shown in FIG. 3 .

Wherein, when it is determined that it is in a stationary state, the mobile phone 100 may execute step S204. That is, the mobile phone 100 can determine whether human eyes are watching the screen.

When it is determined that it is in a non-stationary state, the mobile phone 100 may execute step S205.

S204, the mobile phone 100 determines whether human eyes are watching the screen.

S205, the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.

S206 , the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .

S207 , the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .

For the above steps S204 to S207, reference may be made to steps S105 to S108 in the method shown in FIG. 3 , which will not be repeated here.

FIG. 5 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.

As shown in FIG. 5, the method may include steps S301-S307. in:

S301. The bracelet 200 uses the sleep model to predict that the first user enters the sleep state.

S302 , the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user enters the sleep state.

The above steps S301 and S302 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.

S303. The mobile phone 100 determines whether a user operation is monitored within a preset time.

For the method for the mobile phone 100 to determine whether the user operation is monitored within the preset time, reference may be made to step S204 in the method shown in FIG. 3 .

Wherein, when it is determined that the user operation is not monitored within the preset time, the mobile phone 100 may perform step S304. That is, the mobile phone 100 can determine whether human eyes are watching the screen.

When it is determined that the user operation is monitored within the preset time, the mobile phone 100 may perform step S305.

S304, the mobile phone 100 determines whether human eyes are watching the screen.

S305, the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.

S306 , the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .

S307 , the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .

For the above steps S304 to S307, reference may be made to steps S105 to S108 in the method shown in FIG. 3 , which will not be repeated here.

FIG. 6 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.

As shown in FIG. 6, the method may include steps S401-S406. in:

S401. The bracelet 200 uses the sleep model to predict that the first user enters the sleep state.

S402 , the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user is in a sleep state.

The above steps S401 and S402 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.

S403, the mobile phone 100 determines whether human eyes are watching the screen.

S404, the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.

S405 , the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .

S406 , the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .

For the above steps S403 to S406, reference may be made to steps S105 to S108 in the method shown in FIG. 3 , and details are not repeated here.

In some embodiments, when receiving a request from the bracelet 200 for determining whether the first user enters a sleep state, the mobile phone 100 can monitor whether it is running a screen-casting application. The fact that the mobile phone 100 runs a screen-casting application can indicate that a user is using the mobile phone 100 . When monitoring that it is running an application with screen projection, the mobile phone 100 can detect whether the user of the mobile phone 100 is the first user. In a possible implementation manner, the mobile phone 100 may send a message for capturing images to a screen projection device, such as a TV. When receiving the above-mentioned message from the user for capturing an image, the screen projection device may capture and view an image of the area of the screen projection device, and send the image to the mobile phone 100 . The mobile phone 100 can determine whether the image from the screen projection device includes the face image of the first user.

The fact that the image collected by the screen-casting device includes the face image of the first user may indicate that the first user casts the screen through the mobile phone 100 and watches the content played on the screen-casting device. That is, the first user is not in a sleep state. When it is determined that the image collected by the screen projection device includes the face image of the first user, the mobile phone 100 may send the first judgment result in the foregoing embodiment to the bracelet 200 , indicating that the first user is using the mobile phone 100 .

The fact that the image collected by the screen projection device does not include the face image of the first user may indicate that the users who use the mobile phone 100 to project the screen and watch the content played on the screen projection device do not include the first user. When it is determined that the image collected by the screen projection device does not contain the face image of the first user, the mobile phone 100 may send the second judgment result in the foregoing embodiment to the bracelet 200, indicating that the first user does not use the mobile phone 100.

In an application scenario in which the mobile phone 100 projects a screen, the mobile phone 100 may detect that it is in a stationary state, there is no user operation within a preset time, and no human eyes are watching. However, the first user did not go to sleep, but was watching the screen-casting device. The above method can monitor whether the mobile phone 100 is running a screen-casting application, and monitor whether the first user enters a sleep state by using images collected by the screen-casting device when the screen-casting application is running. This can reduce the misjudgment by the first user that the mobile phone 100 is in a stationary state, has no user operation within a preset time, and has no human eyes, but is still used by the first user to determine whether the first user is in a sleep state.

In some embodiments, when receiving a request from the bracelet 200 for determining whether the first user is in a sleep state, the mobile phone 100 may request other electronic devices having an image capturing device (eg, a camera), such as a TV, to perform image capturing. When an image captured by an electronic device having an image capturing device is obtained, the mobile phone 100 can determine whether the image contains the first user and determine the state of the first user. In this way, the mobile phone 100 can monitor whether the first user enters the sleep state, and send the monitoring result to the bracelet 200 .

Exemplarily, the mobile phone 100 may send a message for capturing images to the TV. The TV can send the images captured by the camera to the mobile phone 100 . The fact that the image collected by the television through the camera includes the face image of the first user may indicate that the first user is watching the television. That is, the first user enters the sleep state. If the mobile phone 100 determines that the image from the TV contains the face image of the first user, the mobile phone 100 can send the first judgment result in the foregoing embodiment to the bracelet 200 to indicate that the first user is using the mobile phone 100 .

The embodiments of the present application do not limit the manner in which the mobile phone 100 establishes a communication connection with an electronic device having an image acquisition device, such as a television. The above-mentioned communication connection manner may be, for example, a Bluetooth connection, a Wi-Fi network connection, or the like.

In some embodiments, the bracelet 200 can establish a communication connection with other electronic devices having image capturing devices. When it is pre-determined that the first user enters the sleep state, the bracelet 200 may send a message for capturing an image to the electronic device having the image capturing device. The electronic device with the image acquisition device can send the acquired image to the bracelet 200 . The bracelet 200 can determine the state of the first user according to these images to determine whether the first user has entered a sleep state. Alternatively, the bracelet 200 can send these images to an electronic device with strong processing capability, such as the mobile phone 100 , among the electronic devices that have established a communication connection with itself. The mobile phone 100 can determine the state of the first user according to the received image, so as to determine whether the first user has entered a sleep state.

The manner in which the bracelet 200 establishes a communication connection with an electronic device having an image acquisition device in this embodiment of the present application is not limited.

In some embodiments, the bracelet 200 can use the mobile phone 100 to determine whether the first user exits the sleep state (ie, the first user wakes up).

Specifically, the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state when monitoring the user operation of unlocking the mobile phone 100 for the first time within the second time period. When receiving the above-mentioned message for instructing the first user to exit the sleep state, the bracelet 200 may determine the time when the user operation of unlocking the mobile phone 100 is detected as the time when the first user exits the sleep state. Combined with the moment when the first user enters the sleep state determined by the sleep monitoring method in the foregoing embodiment, the bracelet 200 can determine the total duration of the first user being in the sleep state, and evaluate the duration of the first user from entering the sleep state to exiting the sleep state. Sleep quality over time.

In particular, the above unlocking method may be a method for unlocking by using biometric information. The biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like. When monitoring that the above-mentioned biometric information belongs to the biometric information of the first user, the mobile phone 100 may determine that the unlocked user is the first user.

The above-mentioned second time period may be a period of time (eg, 12 hours) during which the mobile phone 100 sends the second judgment result to the bracelet 200 to indicate that the first user does not use the mobile phone 100 . Alternatively, the above-mentioned second time period may be a preset time period, for example, a time period from 5:00 am to 10:00 am. The above-mentioned second time period may also be a time period estimated by the bracelet 200 when the first user exits the sleep state. The bracelet 200 can estimate the time period for the first user to exit the sleep state according to the data of the first user detected multiple times.

Optionally, the mobile phone 100 may determine whether the user who turns off the alarm clock of the mobile phone 100 is the first user when monitoring the user's operation to turn off the alarm clock of the mobile phone 100 within the above-mentioned second time period. If it is determined that the user who turns off the alarm clock of the mobile phone 100 is the first user, the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state. When receiving the above-mentioned message for instructing the first user to exit the sleep state, the bracelet 200 may determine the time when the user operation to turn off the alarm clock of the mobile phone 100 is monitored as the time when the first user exits the sleep state. This embodiment of the present application does not limit the method for the mobile phone 100 to determine whether the user who turns off the alarm clock of the mobile phone 100 is the first user. For example, the mobile phone 100 can determine whether the user who turns off the alarm clock is the first user by identifying the biometric information such as face recognition, voiceprint recognition, and fingerprint recognition.

Optionally, the mobile phone 100 may also use the methods shown in FIG. 3 to FIG. 6 to determine whether the first user uses the mobile phone 100 during the second time period. If it is determined that the first user is using the mobile phone 100 , the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state. This embodiment of the present application does not limit the implementation method for the mobile phone 100 to determine whether the first user exits the sleep state.

It is not limited to determining whether the first user uses the mobile phone 100 by monitoring the user operation of unlocking, monitoring the user operation of turning off the alarm clock, and the aforementioned methods shown in FIGS. A user uses it, and then assists the bracelet 200 to determine whether the first user exits the sleep state.

The bracelet 200 may use the sleep model in the foregoing embodiment to determine whether the first user exits the sleep state based on the acceleration data and the heart rate data. However, in some application scenarios (for example, an application scenario in which the first user lies in bed and uses a mobile phone after waking up), the first user has exited the sleep state, but the change in the posture of the bracelet 200 is small or even the posture remains unchanged. Then, the result determined by the bracelet 200 using the sleep model is often that the first user is still in a sleep state. This reduces the accuracy of sleep quality monitoring. The above method of judging whether the first user exits the sleep state by the mobile phone 100 of the bracelet 200 can reduce the misjudgment of whether the first user exits the sleep state when the first user has woken up but does not get up, and improve the accuracy of sleep quality monitoring.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: The technical solutions described in the embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

A sleep monitoring method, characterized in that the method comprises:

The first electronic device receives a first request from the second electronic device; the first electronic device has a binding relationship with the second electronic device; the first request is that the second electronic device is in a wearing state and monitors When the first data is sent, the first data is consistent with the data that the user enters the sleep state;

The first electronic device determines whether the first user wearing the second electronic device is using the first electronic device, and sends the first determination result or the second determination result to the second electronic device; the The first determination result is that the first user is using the first electronic device, and the second determination result is that the first user is not using the first electronic device.
The method according to claim 1, wherein determining by the first electronic device whether the first user wearing the second electronic device is using the first electronic device specifically includes:

The first electronic device determines under a first condition that the first electronic device is being used by a user and the user is the first user, and the first electronic device obtains the first determination result; the first A condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within a first time period, and the first electronic device detects that there is a person Staring at the screen of the first electronic device, and the first electronic device detects that it is running a screen-casting application;

The first electronic device determines under the first condition that the first electronic device is being used by a user and the user is not the first user, or the first electronic device determines that the first electronic device is The device is not used by the user, and the first electronic device obtains the second judgment result.
The method according to claim 2, wherein determining that the user is the first user by the first electronic device specifically includes:

The first electronic device collects a first image through a camera, and determines that the first image includes a face image of the first user.
The method according to any one of claims 1-3, wherein the first data includes one or more of the following: physiological characteristic data of the user, and motion data of the second electronic device.
The method according to any one of claims 1-4, wherein the method further comprises:

During the second time period, the first electronic device monitors a user operation to unlock the first electronic device, the first electronic device sends a first message to the second electronic device, and the first message uses to indicate that the first user is using the first electronic device; or,

During the second time period, the first electronic device detects a user operation to turn off the alarm clock, and the user who turns off the alarm clock is the first user, and the first electronic device sends the second electronic device the information. the first news.
The method according to claim 5, wherein the second time period is a time period of a first duration from when the first electronic device sends the second judgment result to the second electronic device; or , the second time period is a preset time period.
The method according to any one of claims 1-6, wherein the method further comprises:

establishing a binding relationship between the first electronic device and the second electronic device through Bluetooth pairing; or,

The first electronic device establishes a binding relationship with the second electronic device in response to a first user operation, and the first user operation is used to indicate that the owner of the first electronic device is the first user; or ,

The first electronic device and the second electronic device establish a binding relationship by logging into the same account.
A sleep monitoring method, characterized in that the method comprises:

When the second electronic device is in the wearing state, the first data is monitored, and the first data is consistent with the data that the user enters the sleep state;

The second electronic device sends a first request to the first electronic device; the first electronic device has a binding relationship with the second electronic device;

In the case of receiving the first determination result from the first electronic device, the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state; the first determination result is that After receiving the first request, the first electronic device determines a determination result that the first user is using the first electronic device.
The method according to claim 8, wherein after the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state, the method further comprises:

The second electronic device monitors the second data when it is in the wearing state, and determines whether the second data is consistent with the data that the user enters the sleep state.
The method according to claim 8 or 9, wherein after the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state, the method further comprises:

The second electronic device records the monitored physiological characteristic data of the user as data not in a sleep state.
The method according to any one of claims 8-10, wherein the method further comprises:

In the case of receiving the second judgment result from the first electronic device, the second electronic device determines that the first user has entered a sleep state; the second judgment result is that the first electronic device receives After the first request, it is determined that the first user does not use the first electronic device.
The method according to claim 11, wherein after the second electronic device determines that the first user enters a sleep state, the method further comprises:

The second electronic device records the monitored physiological characteristic data of the user as data in a sleep state.
The method according to any one of claims 9-12, wherein the first data and the second data include one or more of the following: physiological characteristic data of the user, the second electronic device movement data.
The method according to any one of claims 11-13, wherein the method further comprises:

The second electronic device receives a first message from the first electronic device when detecting that the state of the first user is a sleep state, and determines that the state of the first user detected by the second electronic device is a sleep state. The state is a non-sleep state; the first message is used to indicate that the first user is using the first electronic device.
A sleep monitoring method, characterized in that the method comprises:

When the second electronic device is in the wearing state, the first data is monitored, and the first data is consistent with the data that the user enters the sleep state;

The second electronic device sends a first request to the first electronic device; the first electronic device has a binding relationship with the second electronic device;

the first electronic device receives the first request from the second electronic device;

The first electronic device determines whether the first user wearing the second electronic device is using the first electronic device, and sends the first determination result or the second determination result to the second electronic device; the The first determination result is that the first user is using the first electronic device, and the second determination result is that the first user is not using the first electronic device;

In the case of receiving the first determination result, the second electronic device determines that the first user is not in a sleep state.
The method according to claim 15, wherein the determining, by the first electronic device, whether the first user wearing the second electronic device is using the first electronic device, specifically comprises:

The first electronic device determines under the first condition that the first electronic device is being used by a user and the user is the first user, and the first electronic device obtains the first determination result; the first A condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within a first time period, and the first electronic device detects that there is a person Staring at the screen of the first electronic device, and the first electronic device detects that it is running a screen-casting application;

The first electronic device determines under the first condition that the first electronic device is being used by a user and the user is not the first user, or the first electronic device determines that the first electronic device is The device is not used by the user, and the first electronic device obtains the second judgment result.
The method according to claim 16, wherein determining that the user is the first user by the first electronic device specifically includes:

The first electronic device collects a first image through a camera, and determines that the first image includes a face image of the first user.
The method according to any one of claims 15-17, wherein the method further comprises:

In the case of receiving the second judgment result, the second electronic device determines that the first user enters a sleep state.
The method according to any one of claims 15-18, wherein the method further comprises:

During the second time period, the first electronic device monitors a user operation to unlock the first electronic device, the first electronic device sends a first message to the second electronic device, and the first message uses to indicate that the first user is using the first electronic device; or,

During the second time period, the first electronic device detects a user operation to turn off the alarm clock, and the user who turns off the alarm clock is the first user, and the first electronic device sends the second electronic device the information. the first news.
The method according to any one of claims 15-19, wherein the method further comprises:

establishing a binding relationship between the first electronic device and the second electronic device through Bluetooth pairing; or,

The first electronic device establishes a binding relationship with the second electronic device in response to a first user operation, and the first user operation is used to indicate that the owner of the first electronic device is the first user; or ,

The first electronic device and the second electronic device establish a binding relationship by logging into the same account.
A sleep monitoring method, characterized in that the method comprises:

The second electronic device receives the first message from the first electronic device when detecting that the state of the first user wearing the second electronic device is a sleep state, and determines that the first message detected by the second electronic device is in the sleep state. The state of the user is a non-sleep state; the first electronic device has a binding relationship with the second electronic device; the first message is that the first electronic device detects that the first electronic device has unlocked the Sent after a user operation of the first electronic device.
The method according to claim 21, wherein before the second electronic device detects that the state of the first user wearing the second electronic device is a sleep state, the method further comprises:

The second electronic device detects the first data when it is in the wearing state, and the first data is consistent with the data that the user enters the sleep state;

the second electronic device sends a first request to the first electronic device;

The second electronic device receives a determination result that the first electronic device indicates that the first user does not use the first electronic device.
The method according to claim 21 or 22, wherein the first monitoring time period is a time period during which the second electronic device estimates that the first user exits a sleep state.
The method according to claim 22, wherein the first monitoring time period is the transmission of the indication that the first user is not using the first electronic device from the first electronic device to the second electronic device The first time period when the judgment result of the electronic device starts.
A sleep monitoring method, characterized in that the method comprises:

The first electronic device monitors the user operation of unlocking the first electronic device within the first monitoring time period, and sends a first message to the second electronic device; the first electronic device and the second electronic device are bound relation;

The second electronic device receives the first message when detecting that the state of the first user is a sleep state, and determines that the state of the first user detected by the second electronic device is a non-sleep state.
The method according to claim 25, wherein before the second electronic device determines that the first user is in a sleep state, the method further comprises:

The second electronic device detects the first data when it is in the wearing state, and the first data is consistent with the data that the user enters the sleep state;

the second electronic device sends a first request to the first electronic device;

The first electronic device receives the first request, determines whether the first user is using the first electronic device, and obtains a determination result indicating that the first user is not using the first electronic device; The first electronic device sends the judgment result indicating that the first user does not use the first electronic device to the second electronic device.
The method according to claim 25 or 26, wherein the first monitoring time period is a time period during which the second electronic device estimates that the first user exits a sleep state.
The method according to claim 26, wherein the first monitoring time period is the transmission of the indication that the first user is not using the first electronic device from the first electronic device to the second electronic device The first time period when the judgment result of the electronic device starts.
An electronic device, the electronic device is a first electronic device, characterized in that it comprises: a camera, a communication module, a memory and a processor; the camera is used for capturing images; the communication module is used for communicating with a second electronic device establishing a communication connection; the memory is used for storing a computer program; the processor is used for invoking the computer program, so that the first electronic device executes the method of any one of claims 1-7.
An electronic device, the electronic device is a second electronic device, characterized in that it comprises: a communication module, a memory and a processor; the communication module is used for establishing a communication connection with the first electronic device; the memory is used for storing A computer program; the processor is configured to invoke the computer program, so that the second electronic device executes the method of any one of claims 8-14 or claims 21-24.
A sleep monitoring system, characterized in that, the system comprises the first electronic device of claim 29 and the second electronic device of claim 30 .
A computer storage medium, characterized in that it includes: computer instructions; when the computer instructions are executed on an electronic device, the electronic device is made to execute the steps of claims 1-7 or 8-14 or claims 21- The method of any one of 24.
A computer program product, characterized in that, when the computer program product is run on an electronic device, the electronic device is made to execute any one of claims 1-7 or 8-14 or 21-24 method described in item.