CN113591666A - Control method and device applied to mobile phone, computer readable medium and mobile phone - Google Patents
Control method and device applied to mobile phone, computer readable medium and mobile phone Download PDFInfo
- Publication number
- CN113591666A CN113591666A CN202110842845.5A CN202110842845A CN113591666A CN 113591666 A CN113591666 A CN 113591666A CN 202110842845 A CN202110842845 A CN 202110842845A CN 113591666 A CN113591666 A CN 113591666A
- Authority
- CN
- China
- Prior art keywords
- video monitoring
- mobile phone
- state
- human eyes
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000012544 monitoring process Methods 0.000 claims abstract description 114
- 230000004397 blinking Effects 0.000 claims abstract description 40
- 210000000744 eyelid Anatomy 0.000 claims description 18
- 241001282135 Poromitra oscitans Species 0.000 claims description 7
- 206010048232 Yawning Diseases 0.000 claims description 7
- 230000007704 transition Effects 0.000 claims description 7
- GOLXNESZZPUPJE-UHFFFAOYSA-N spiromesifen Chemical compound CC1=CC(C)=CC(C)=C1C(C(O1)=O)=C(OC(=O)CC(C)(C)C)C11CCCC1 GOLXNESZZPUPJE-UHFFFAOYSA-N 0.000 claims description 5
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims description 4
- 238000004088 simulation Methods 0.000 claims description 4
- 230000002159 abnormal effect Effects 0.000 claims description 3
- 230000005856 abnormality Effects 0.000 claims description 3
- 238000009825 accumulation Methods 0.000 claims description 3
- 238000004590 computer program Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 claims description 3
- 230000001413 cellular effect Effects 0.000 claims 1
- 230000006870 function Effects 0.000 description 33
- 230000000193 eyeblink Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72463—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions to restrict the functionality of the device
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
Abstract
The invention provides a control method applied to a mobile phone, which is characterized by comprising the following steps: s100, starting a camera after a mobile phone screen is unlocked; s200, performing video monitoring every ten minutes through the camera, wherein the duration of each video monitoring is one minute; s300, acquiring the blinking times of the human eyes after video monitoring is finished each time; s300a, when the blinking times of human eyes in one video monitoring is less than 3, the human eyes are considered to be in a normal use state; s300b, when the blinking times of human eyes in one video monitoring is more than or equal to 3 times and less than 6 times, the human eyes are regarded as a sub-health state, and then the video monitoring is directly carried out for one time; and S300c, when the blinking times of human eyes in one video monitoring is more than or equal to 6 times, the user is considered to be in an exhausted state, and the screen is locked to prohibit the user from continuing to use the mobile phone.
Description
Technical Field
The present invention relates to the field of mobile phone control technologies, and in particular, to a control method and apparatus applied to a mobile phone, a computer-readable medium, and a mobile phone.
Background
The mobile phone, which is called as a mobile phone or a wireless phone, is usually called as a mobile phone, and originally is only a communication tool, with the development of the times, the mobile phone derives diversified functions, which also brings great temptation to users, especially to users needing to be supervised, such as adults or minors with insufficient self-control.
In the case of minors who need to be monitored and adults who want to do without self control, the current mobile phone control method lacks monitoring and judgment about tired use, and is difficult to help users to remove the mobile phone from use in tired state and slow down mobile phone control. Therefore, a control method, an apparatus, a computer-readable medium, and a mobile phone applied to the mobile phone are needed.
Disclosure of Invention
The invention provides a control method and device applied to a mobile phone, a computer readable medium and the mobile phone, and aims to solve the technical problems mentioned in the background technology.
The invention firstly provides a control method applied to a mobile phone, which comprises the following steps:
s100, starting a camera after a mobile phone screen is unlocked;
s200, performing video monitoring every ten minutes through the camera, wherein the duration of each video monitoring is one minute, and the video monitoring specifically comprises the following steps:
s201a, when video monitoring is carried out, the human eyes are captured and recognized by image capture, and the upper eyelid of the human eyes and the lower eyelid of the human eyes are respectively simulated to be a first upper arc line and a first lower arc line;
s202a, acquiring the distance between the midpoint of the first upper arc and the midpoint of the first lower arc, and establishing a human eye state function curve of the distance and the time;
s203a, outputting a first positive level signal when the human eye state function curve is smaller than or equal to a preset eye closing threshold value, and outputting a first negative level signal when the human eye state function curve is larger than the preset eye closing threshold value, wherein the preset eye closing threshold value is a set value which is judged to be in an eye closing state through a preset numerical value;
s204a, generating a first flag signal whenever there is a transition of said first positive level signal to said first negative level signal, wherein the number of said first flag signals represents the number of blinks of the human eye;
s300, acquiring the blinking times of the human eyes after video monitoring is finished each time;
s300a, when the blinking times of human eyes in one video monitoring is less than 3, the human eyes are considered to be in a normal use state;
s300b, when the blinking times of human eyes in one video monitoring is more than or equal to 3 times and less than 6 times, the human eyes are regarded as a sub-health state, and then the video monitoring is directly carried out for one time;
and S300c, when the blinking times of human eyes in one video monitoring is more than or equal to 6 times, the user is considered to be in an exhausted state, and the screen is locked to prohibit the user from continuing to use the mobile phone.
Further, after "outputting a positive level signal when the eye state function curve is smaller than or equal to a preset eye closing threshold, and outputting a negative level signal when the eye state function curve is greater than the preset eye closing threshold", the method further includes:
when the positive level signal is detected to be continuously output for more than 10 seconds, the mobile phone is considered to be in an exhausted state, and the mobile phone is prohibited from being used continuously at the moment.
Further, the method also comprises an abnormality identification step, which comprises the following steps:
when the face cannot be obtained from the image obtained by the camera, early warning and timing are started;
and when the timing reaches the preset time, the mobile phone is considered to be in an abnormal state, and the screen is locked to forbid the mobile phone from being used continuously.
Further, the method also comprises a screen touch detection step, which comprises the following steps:
when the screen is clicked, triggering a recording point and storing the recording point;
triggering the recording points each time, calculating the time interval between the front recording point and the rear recording point and storing the latest ten time intervals;
when the average value of the last five time intervals is detected to be more than or equal to twice of the average value of the rest five time intervals, the state is regarded as a sub-health state, and the video monitoring is directly carried out for one time.
Further, the video monitoring also comprises the following steps:
acquiring an image signal displayed by a display screen of a mobile phone, wherein the image signal is sent by a controller to control the display of the display screen of the mobile phone;
respectively recording R value, G value and B value of RGB value in image signal in each frame;
accumulating the R value sum, the G value sum and the B value sum of all the image signals;
when the blinking times of human eyes in one video monitoring is more than or equal to 3 times and less than 6 times, acquiring the R value sum, the G value sum and the B value sum of all image signals in the video monitoring, and comparing the R value sum, the G value sum and the B value sum with preset warning values respectively;
if any two items of the R value sum, the G value sum and the B value sum exceed the preset warning value, judging that the interference factor exists, and still considering the normal use state.
Further, when the user is detected to be in a sub-health state in three consecutive video monitoring, the user is adjusted to be in an exhausted state, and at the moment, the screen is locked to prohibit the user from continuing to use the mobile phone.
Further, the video monitoring also comprises the following steps:
s201b, when video monitoring is carried out, the human lips are captured and recognized by image capture, and the upper lips and the lower lips of the lips are respectively simulated to be second upper arc lines and second lower arc lines;
s202b, acquiring the distance between the midpoint of the second upper arc and the midpoint of the second lower arc, and establishing a lip state function curve of the distance and time;
s203b, outputting a second positive level signal when the lip state function curve is less than or equal to a preset mouth opening threshold value, and outputting a second negative level signal when the lip state function curve is greater than the preset mouth opening threshold value, wherein the preset mouth opening threshold value is a set value which is judged to be in mouth expansion through a preset numerical value;
s204b, when the second negative level signal is detected to last for more than 5 seconds, generating a second mark signal, wherein the number of the second mark signal refers to the number of times of yawning;
and S205b, when the yawning times in one video monitoring is more than or equal to 2 times, determining that the video monitoring is in a sub-health state, and directly continuing the one-time video monitoring.
The invention also provides a control device applied to the mobile phone, which comprises:
the initialization module is used for starting the camera after the mobile phone screen is unlocked;
the monitoring module is used for performing video monitoring every ten minutes through the camera, wherein the duration of each video monitoring is one minute, and the video monitoring module specifically comprises an automatic grabbing module, an analog function generating module, a state output module and a first marking signal generating module;
the automatic grabbing module is used for grabbing and identifying human eyes in an image mode when video monitoring is carried out, and simulating upper eyelids of the human eyes and lower eyelids of the human eyes to be a first upper arc line and a first lower arc line respectively;
the simulation function generating module is used for acquiring the distance between the midpoint of the first upper arc and the midpoint of the first lower arc and establishing a human eye state function curve of the distance and time;
the state output module is used for outputting a first positive level signal when the human eye state function curve is smaller than or equal to a preset eye closing threshold value, and outputting a first negative level signal when the human eye state function curve is larger than the preset eye closing threshold value, wherein the preset eye closing threshold value is a set value which is judged to be in an eye closing state through a preset numerical value;
a first flag signal generation module for generating a first flag signal whenever there is a transition of said first positive level signal to said first negative level signal, wherein the number of said first flag signals represents the number of blinks of the human eye;
the first marking signal accumulation module is used for acquiring the blinking times of human eyes after video monitoring is finished each time;
the first execution module is used for regarding the video monitoring module as a normal use state when the blinking times of human eyes in one video monitoring is less than 3 times;
the second execution module is used for judging the video monitoring to be in a sub-health state when the blinking times of human eyes in one video monitoring are more than or equal to 3 times and less than 6 times, and then directly continuing the one video monitoring;
and the third execution module is used for judging the state of fatigue when the number of times of blinking of human eyes in one video monitoring is more than or equal to 6 times, and at the moment, the screen is locked to forbid the mobile phone from being used continuously.
The present invention also provides a computer-readable medium on which a computer program is stored, wherein the program is configured to implement the above-mentioned control method applied to a mobile phone when being processed and executed.
The present invention also provides a mobile phone, including:
one or more processors;
a storage device for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the above-described control method applied to a mobile phone.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: firstly, the state of a user is monitored by setting video monitoring, the fatigue degree of the user is judged by using the blinking times of human eyes, and corresponding supervision control is executed. And then the state of human eyes is clearly shown through the change of the distance between the upper eyelid and the lower eyelid of the human eyes by setting the blink identification method steps, so that whether the human eyes blink or not and the blink frequency can be more directly judged. And finally, dividing the eye blink time into normal, sub-healthy and tired states according to different blink times, and carrying out supervision of different degrees according to different tired degrees so as to achieve the aim of assisting in controlling the problem that the user excessively plays the mobile phone.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
Fig. 1 is a flowchart illustrating steps of a control method applied to a mobile phone according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating the steps of the blink recognition method of the embodiment of fig. 1.
Fig. 3 is a flow chart of the steps of the yawning identification method of the embodiment of fig. 1.
FIG. 4 is a simulated view of the state function curve of the human eye of the embodiment of FIG. 1.
FIG. 5 is a state simulation diagram of the first level signal of the embodiment of FIG. 1.
Fig. 6 is a block diagram of a control device applied to a mobile phone according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative only and should not be construed as limiting the invention.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, or operations, but do not preclude the presence or addition of one or more other features, integers, steps, operations, or groups thereof.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
It will be appreciated by those skilled in the art that the terms "application," "application program," "application software," and the like, as used herein, are intended to refer to a computer software product electronically-adapted to be electronically-constructed, from a collection of computer instructions and associated data resources, in accordance with the principles of the present invention. Unless otherwise specified, such nomenclature is not itself limited by the programming language class, level, or operating system or platform upon which it depends. Of course, such concepts are not limited to any type of terminal.
Referring to fig. 1-5, the present invention first provides a control method applied to a mobile phone, including the following steps:
and S100, starting the camera after the screen of the mobile phone is unlocked.
S200, performing video monitoring every ten minutes through the camera, wherein the duration of each video monitoring is one minute, and the video monitoring specifically comprises the following steps:
s201a, when video monitoring is carried out, the human eyes are recognized by image capture, and the upper eyelid of the human eyes and the lower eyelid of the human eyes are simulated to be a first upper arc line and a first lower arc line respectively.
S202a, acquiring the distance between the midpoint of the first upper arc and the midpoint of the first lower arc, and establishing a human eye state function curve of the distance and the time.
And S203a, outputting a first positive level signal when the human eye state function curve is smaller than or equal to a preset eye closing threshold value, and outputting a first negative level signal when the human eye state function curve is larger than the preset eye closing threshold value, wherein the preset eye closing threshold value is a set value which is judged to be in the eye closing state through a preset numerical value.
And S204a generating a first flag signal whenever there is a transition of said first positive level signal to said first negative level signal, wherein the number of said first flag signals represents the number of blinks of the human eye.
In the embodiment, by setting a preset eye closing threshold (generally slightly larger than 0), the human eye state function is divided, the human eye is judged to be in an eye closing state or an eye closing state by using the output of the level signal, and then whether the eye blink exists is judged, and the number of the marking signals is used as the number of times of eye blinking.
And S300, acquiring the blinking times of the human eyes after the video monitoring is finished each time.
And S300a, when the blinking times of human eyes in one video monitoring is less than 3 times, the video monitoring is regarded as a normal use state.
And S300b, when the blinking times of human eyes in one video monitoring are more than or equal to 3 times and less than 6 times, the human eyes are regarded as a sub-health state, and the video monitoring is directly continued for one time.
And S300c, when the blinking times of human eyes in one video monitoring is more than or equal to 6 times, the user is considered to be in an exhausted state, and the screen is locked to prohibit the user from continuing to use the mobile phone.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: firstly, the state of a user is monitored by setting video monitoring, the fatigue degree of the user is judged by using the blinking times of human eyes, and corresponding supervision control is executed. And then the state of human eyes is clearly shown through the change of the distance between the upper eyelid and the lower eyelid of the human eyes by setting the blink identification method steps, so that whether the human eyes blink or not and the blink frequency can be more directly judged. And finally, dividing the eye blink time into normal, sub-healthy and tired states according to different blink times, and carrying out supervision of different degrees according to different tired degrees so as to achieve the aim of assisting in controlling the problem that the user excessively plays the mobile phone.
In an embodiment of the present invention, the video monitoring further comprises the following steps:
s201b, when video monitoring is carried out, image capture is carried out to identify human lips, and the upper lips and the lower lips of the lips are respectively simulated to be second upper arc lines and second lower arc lines.
S202b, acquiring the distance between the middle point of the second upper arc and the middle point of the second lower arc, and establishing a lip state function curve of the distance and time.
And S203b, outputting a second positive level signal when the lip state function curve is less than or equal to a preset mouth opening threshold value, and outputting a second negative level signal when the lip state function curve is greater than the preset mouth opening threshold value, wherein the preset mouth opening threshold value is a set value which is judged to be in mouth expansion through a preset numerical value.
S204b, when the second negative level signal is detected to last for more than 5 seconds, generating a second mark signal, wherein the number of the second mark signal refers to the number of times of yawning;
and S205b, when the yawning times in one video monitoring is more than or equal to 2 times, determining that the video monitoring is in a sub-health state, and directly continuing the one-time video monitoring.
Preferably, in an embodiment of the present invention, after "outputting a positive level signal when the eye state function curve is smaller than or equal to a preset eye closing threshold, and outputting a negative level signal when the eye state function curve is greater than the preset eye closing threshold", the method further includes:
when the positive level signal is detected to be continuously output for more than 10 seconds, the mobile phone is considered to be in an exhausted state, and the mobile phone is prohibited from being used continuously at the moment.
Preferably, in an embodiment of the present invention, the control method further includes an abnormality recognition step, including:
and when the face cannot be acquired from the image acquired by the camera, early warning and timing are started.
And when the timing reaches the preset time, the mobile phone is considered to be in an abnormal state, and the screen is locked to forbid the mobile phone from being used continuously.
Preferably, in an embodiment of the present invention, the control method further includes a screen touch detection step, including:
when the screen is clicked, triggering a recording point and storing the recording point;
triggering the recording points each time, calculating the time interval between the front recording point and the rear recording point and storing the latest ten time intervals;
when the average value of the last five time intervals is detected to be more than or equal to twice of the average value of the rest five time intervals, the state is regarded as a sub-health state, and the video monitoring is directly carried out for one time.
In this embodiment, the click interval increases with the increase of fatigue degree during the long-time use of the user, and when the click interval in a certain period of time is significantly greater than the click interval in the previous period of time, the user should be regarded as being in a fatigue state, and at this time, video monitoring is performed to judge whether the user needs to be supervised and controlled to use the mobile phone.
Preferably, in an embodiment of the present invention, the video monitoring further includes the following steps:
acquiring an image signal displayed by a display screen of a mobile phone, wherein the image signal is sent by a controller to control the display of the display screen of the mobile phone;
respectively recording R value, G value and B value of RGB value in image signal in each frame;
accumulating the R value sum, the G value sum and the B value sum of all the image signals;
when the blinking times of human eyes in one video monitoring is more than or equal to 3 times and less than 6 times, acquiring the R value sum, the G value sum and the B value sum of all image signals in the video monitoring, and comparing the R value sum, the G value sum and the B value sum with preset warning values respectively;
if any two items of the R value sum, the G value sum and the B value sum exceed the preset warning value, judging that the interference factor exists, and still considering the normal use state.
In this embodiment, by performing RGB value monitoring on a picture displayed in a display screen of a mobile phone (R value represents red, G value represents green, and B value represents blue), when any two of the total sum of R value, the total sum of G value, and the total sum of B value in a unit time exceed a preset warning value, the picture is considered to be too dazzling, which is likely to cause involuntary blinking of human eyes and affect interference on blinking factors, so that interference needs to be eliminated, and the picture is considered to be in a normal use state.
Further, when the user is detected to be in a sub-health state in three consecutive video monitoring, the user is adjusted to be in an exhausted state, and at the moment, the screen is locked to prohibit the user from continuing to use the mobile phone.
In one embodiment, the present invention provides a control device 100 applied to a mobile phone, wherein the device 100 stores a plurality of instructions, the instructions are suitable for being loaded by a processor and executing a control method applied to the mobile phone, and the control method comprises the following steps:
and S100, starting the camera after the screen of the mobile phone is unlocked.
And S200, performing video monitoring every ten minutes through the camera, wherein the duration of each video monitoring is one minute.
S201a, when video monitoring is carried out, the human eyes are recognized by image capture, and the upper eyelid of the human eyes and the lower eyelid of the human eyes are simulated to be a first upper arc line and a first lower arc line respectively.
S202a, acquiring the distance between the midpoint of the first upper arc and the midpoint of the first lower arc, and establishing a human eye state function curve of the distance and the time.
And S203a, outputting a first positive level signal when the human eye state function curve is smaller than or equal to a preset eye closing threshold value, and outputting a first negative level signal when the human eye state function curve is larger than the preset eye closing threshold value, wherein the preset eye closing threshold value is a set value which is judged to be in the eye closing state through a preset numerical value.
And S204a generating a first flag signal whenever there is a transition of said first positive level signal to said first negative level signal, wherein the number of said first flag signals represents the number of blinks of the human eye.
And S300, acquiring the blinking times of the human eyes after the video monitoring is finished each time.
And S300a, when the blinking times of human eyes in one video monitoring is less than 3 times, the video monitoring is regarded as a normal use state.
And S300b, when the blinking times of human eyes in one video monitoring are more than or equal to 3 times and less than 6 times, the human eyes are regarded as a sub-health state, and the video monitoring is directly continued for one time.
And S300c, when the blinking times of human eyes in one video monitoring is more than or equal to 6 times, the user is considered to be in an exhausted state, and the screen is locked to prohibit the user from continuing to use the mobile phone.
For convenience of description, the apparatus 100 is split into a functional module architecture, as shown in fig. 6, including:
the initialization module 10 is used for starting a camera after a mobile phone screen is unlocked;
the monitoring module 20 is configured to perform video monitoring every ten minutes by using the camera, where the duration of each video monitoring is one minute, and the video monitoring specifically includes an automatic capture module, an analog function generation module, a state output module, and a first flag signal generation module;
the automatic grabbing module 21 is used for grabbing and identifying human eyes in an image mode when video monitoring is carried out, and simulating upper eyelids of the human eyes and lower eyelids of the human eyes to be a first upper arc line and a first lower arc line respectively;
the simulation function generating module 22 is configured to obtain a distance between a midpoint of the first upper arc and a midpoint of the first lower arc, and establish an eye state function curve of the distance and time;
the state output module 23 is configured to output a first positive level signal when the eye state function curve is smaller than or equal to a preset eye closing threshold, and output a first negative level signal when the eye state function curve is larger than the preset eye closing threshold, where the preset eye closing threshold is a set value determined to be in an eye closing state according to a preset value;
a first flag signal generation block 24 for generating a first flag signal whenever there is a transition of said first positive level signal to said first negative level signal, wherein the number of said first flag signals represents the number of blinks of the human eye;
the first marking signal accumulation module 30 is used for acquiring the blinking times of the human eyes after the video monitoring is finished each time;
the first execution module 40 is used for regarding the video monitoring as a normal use state when the blinking times of human eyes in one video monitoring are less than 3;
the second execution module 50 is used for regarding the human eye as a sub-health state when the blinking times of the human eye in one video monitoring is more than or equal to 3 times and less than 6 times, and then directly continuing one video monitoring;
and a third executing module 60, configured to regard the mobile phone as an exhausted state when the number of times of blinking of human eyes in one video monitoring is greater than or equal to 6, and at this time, lock the screen to prohibit the mobile phone from being used continuously.
The present invention also provides a computer-readable medium on which a computer program is stored, wherein the program is configured to implement the above-mentioned control method applied to a mobile phone when being processed and executed.
The present invention also provides a mobile phone, including:
one or more processors;
a storage device for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the above-described control method applied to a mobile phone.
Throughout the description and claims of this application, the words "comprise/comprises" and the words "have/includes" and variations of these are used to specify the presence of stated features, values, steps or components but do not preclude the presence or addition of one or more other features, values, steps, components or groups thereof.
Some features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, certain features of the invention, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable combination in different embodiments.
Various embodiments of the present invention have been described in detail above. Finally, it should be noted that the above embodiments are only used for illustrating the technical solutions of the present invention and not for limiting the same. Although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A control method applied to a mobile phone is characterized by comprising the following steps:
s100, starting a camera after a mobile phone screen is unlocked;
s200, performing video monitoring every ten minutes through the camera, wherein the duration of each video monitoring is one minute, and the video monitoring specifically comprises the following steps:
s201a, when video monitoring is carried out, the human eyes are captured and recognized by image capture, and the upper eyelid of the human eyes and the lower eyelid of the human eyes are respectively simulated to be a first upper arc line and a first lower arc line;
s202a, acquiring the distance between the midpoint of the first upper arc and the midpoint of the first lower arc, and establishing a human eye state function curve of the distance and the time;
s203a, outputting a first positive level signal when the human eye state function curve is smaller than or equal to a preset eye closing threshold value, and outputting a first negative level signal when the human eye state function curve is larger than the preset eye closing threshold value, wherein the preset eye closing threshold value is a set value which is judged to be in an eye closing state through a preset numerical value;
s204a, generating a first flag signal whenever there is a transition of said first positive level signal to said first negative level signal, wherein the number of said first flag signals represents the number of blinks of the human eye;
s300, acquiring the blinking times of the human eyes after video monitoring is finished each time;
s300a, when the blinking times of human eyes in one video monitoring is less than 3, the human eyes are considered to be in a normal use state;
s300b, when the blinking times of human eyes in one video monitoring is more than or equal to 3 times and less than 6 times, the human eyes are regarded as a sub-health state, and then the video monitoring is directly carried out for one time;
and S300c, when the blinking times of human eyes in one video monitoring is more than or equal to 6 times, the user is considered to be in an exhausted state, and the screen is locked to prohibit the user from continuing to use the mobile phone.
2. The control method applied to the mobile phone according to claim 1, further comprising, after outputting a positive level signal when the eye state function curve is less than or equal to a preset eye closing threshold and outputting a negative level signal when the eye state function curve is greater than the preset eye closing threshold:
when the positive level signal is detected to be continuously output for more than 10 seconds, the mobile phone is considered to be in an exhausted state, and the mobile phone is prohibited from being used continuously at the moment.
3. The control method applied to the mobile phone according to claim 1, further comprising an abnormality recognition step comprising:
when the face cannot be obtained from the image obtained by the camera, early warning and timing are started;
and when the timing reaches the preset time, the mobile phone is considered to be in an abnormal state, and the screen is locked to forbid the mobile phone from being used continuously.
4. The control method applied to the mobile phone according to claim 1, further comprising a screen touch detection step comprising:
when the screen is clicked, triggering a recording point and storing the recording point;
triggering the recording points each time, calculating the time interval between the front recording point and the rear recording point and storing the latest ten time intervals;
when the average value of the last five time intervals is detected to be more than or equal to twice of the average value of the rest five time intervals, the state is regarded as a sub-health state, and the video monitoring is directly carried out for one time.
5. The control method applied to the mobile phone according to claim 1, wherein the video monitoring further comprises the following steps:
acquiring an image signal displayed by a display screen of a mobile phone, wherein the image signal is sent by a controller to control the display of the display screen of the mobile phone;
respectively recording R value, G value and B value of RGB value in image signal in each frame;
accumulating the R value sum, the G value sum and the B value sum of all the image signals;
when the blinking times of human eyes in one video monitoring is more than or equal to 3 times and less than 6 times, acquiring the R value sum, the G value sum and the B value sum of all image signals in the video monitoring, and comparing the R value sum, the G value sum and the B value sum with preset warning values respectively;
if any two items of the R value sum, the G value sum and the B value sum exceed the preset warning value, judging that the interference factor exists, and still considering the normal use state.
6. The control method as claimed in claim 1, wherein when the user is in sub-health status during three consecutive video monitoring, the user is adjusted to fatigue status, and the screen is locked to prohibit further use of the mobile phone.
7. The control method applied to the mobile phone according to claim 1, wherein the video monitoring further comprises the following steps:
s201b, when video monitoring is carried out, the human lips are captured and recognized by image capture, and the upper lips and the lower lips of the lips are respectively simulated to be second upper arc lines and second lower arc lines;
s202b, acquiring the distance between the midpoint of the second upper arc and the midpoint of the second lower arc, and establishing a lip state function curve of the distance and time;
s203b, outputting a second positive level signal when the lip state function curve is less than or equal to a preset mouth opening threshold value, and outputting a second negative level signal when the lip state function curve is greater than the preset mouth opening threshold value, wherein the preset mouth opening threshold value is a set value which is judged to be in mouth expansion through a preset numerical value;
s204b, when the second negative level signal is detected to last for more than 5 seconds, generating a second mark signal, wherein the number of the second mark signal refers to the number of times of yawning;
and S205b, when the yawning times in one video monitoring is more than or equal to 2 times, determining that the video monitoring is in a sub-health state, and directly continuing the one-time video monitoring.
8. A control device applied to a mobile phone is characterized by comprising:
the initialization module is used for starting the camera after the mobile phone screen is unlocked;
the monitoring module is used for carrying out video monitoring every ten minutes through the camera, wherein the duration of each video monitoring is one minute, and the video monitoring specifically comprises an automatic grabbing module, an analog function generating module, a state output module and a first marking signal generating module:
the automatic grabbing module is used for grabbing and identifying human eyes in an image mode when video monitoring is carried out, and simulating upper eyelids of the human eyes and lower eyelids of the human eyes to be a first upper arc line and a first lower arc line respectively;
the simulation function generating module is used for acquiring the distance between the midpoint of the first upper arc and the midpoint of the first lower arc and establishing a human eye state function curve of the distance and time;
the state output module is used for outputting a first positive level signal when the human eye state function curve is smaller than or equal to a preset eye closing threshold value, and outputting a first negative level signal when the human eye state function curve is larger than the preset eye closing threshold value, wherein the preset eye closing threshold value is a set value which is judged to be in an eye closing state through a preset numerical value;
a first flag signal generation module for generating a first flag signal whenever there is a transition of said first positive level signal to said first negative level signal, wherein the number of said first flag signals represents the number of blinks of the human eye;
the first marking signal accumulation module is used for acquiring the blinking times of human eyes after video monitoring is finished each time;
the first execution module is used for regarding the video monitoring module as a normal use state when the blinking times of human eyes in one video monitoring is less than 3 times;
the second execution module is used for judging the video monitoring to be in a sub-health state when the blinking times of human eyes in one video monitoring are more than or equal to 3 times and less than 6 times, and then directly continuing the one video monitoring;
and the third execution module is used for judging the state of fatigue when the number of times of blinking of human eyes in one video monitoring is more than or equal to 6 times, and at the moment, the screen is locked to forbid the mobile phone from being used continuously.
9. A computer-readable medium on which a computer program is stored, the program, when being processed and executed, implementing the control method applied to a mobile phone according to any one of claims 1 to 7.
10. A cellular phone, comprising:
one or more processors;
a storage device for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the control method applied to a handset as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110842845.5A CN113591666A (en) | 2021-07-26 | 2021-07-26 | Control method and device applied to mobile phone, computer readable medium and mobile phone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110842845.5A CN113591666A (en) | 2021-07-26 | 2021-07-26 | Control method and device applied to mobile phone, computer readable medium and mobile phone |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113591666A true CN113591666A (en) | 2021-11-02 |
Family
ID=78250058
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110842845.5A Pending CN113591666A (en) | 2021-07-26 | 2021-07-26 | Control method and device applied to mobile phone, computer readable medium and mobile phone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113591666A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103778785A (en) * | 2012-10-23 | 2014-05-07 | 南开大学 | Vehicle tracking and detecting method based on parking lot environment video monitoring |
| CN103886288A (en) * | 2014-03-13 | 2014-06-25 | 惠州Tcl移动通信有限公司 | Sleepy state detecting method and system |
| CN104361716A (en) * | 2014-10-31 | 2015-02-18 | 新疆宏开电子系统集成有限公司 | Method for detecting and reminding fatigue in real time |
| CN105373767A (en) * | 2015-07-23 | 2016-03-02 | 中山大学深圳研究院 | Eye fatigue detection method for smart phones |
| KR20160123200A (en) * | 2015-04-15 | 2016-10-25 | 삼성전자주식회사 | Touch input processing method and electronic device supporting the same |
| CN108415653A (en) * | 2018-03-27 | 2018-08-17 | 百度在线网络技术（北京）有限公司 | Screen locking method and device for terminal device |
| CN110245574A (en) * | 2019-05-21 | 2019-09-17 | 平安科技（深圳）有限公司 | A kind of human fatigue state identification method, device and terminal device |
-
2021
- 2021-07-26 CN CN202110842845.5A patent/CN113591666A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103778785A (en) * | 2012-10-23 | 2014-05-07 | 南开大学 | Vehicle tracking and detecting method based on parking lot environment video monitoring |
| CN103886288A (en) * | 2014-03-13 | 2014-06-25 | 惠州Tcl移动通信有限公司 | Sleepy state detecting method and system |
| CN104361716A (en) * | 2014-10-31 | 2015-02-18 | 新疆宏开电子系统集成有限公司 | Method for detecting and reminding fatigue in real time |
| KR20160123200A (en) * | 2015-04-15 | 2016-10-25 | 삼성전자주식회사 | Touch input processing method and electronic device supporting the same |
| CN105373767A (en) * | 2015-07-23 | 2016-03-02 | 中山大学深圳研究院 | Eye fatigue detection method for smart phones |
| CN108415653A (en) * | 2018-03-27 | 2018-08-17 | 百度在线网络技术（北京）有限公司 | Screen locking method and device for terminal device |
| CN110245574A (en) * | 2019-05-21 | 2019-09-17 | 平安科技（深圳）有限公司 | A kind of human fatigue state identification method, device and terminal device |
Non-Patent Citations (3)
| Title |
|---|
| JI Y等: "Eye and mouth state detection algorithm based on contour feature extraction", 《 JOURNAL OF ELECTRONIC IMAGING》, vol. 27, no. 5, 9 February 2018 (2018-02-09), pages 1 - 9 * |
| 张逸新: "《 数字印刷原理与工艺》", vol. 1, 30 June 2007, 中国轻工业出版社, pages: 216 * |
| 项奕阳: "基于图像处理的上课疲劳检测", 《电子测试》, vol. 14, 15 July 2019 (2019-07-15), pages 55 - 57 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106201304A (en) | A kind of method and device of false-touch prevention operation | |
| CN107566643B (en) | Information processing method, information processing apparatus, storage medium, and electronic device | |
| DE102015109205A1 (en) | Customize device notifications based on user proximity | |
| CN107666583B (en) | Call processing method and terminal | |
| CN113055530A (en) | Mode switching method and device | |
| CN108683855A (en) | Camera control method and terminal equipment | |
| CN106814838A (en) | The method and apparatus of terminal auto sleep | |
| CN114648354A (en) | Advertisement evaluation method and system based on eye movement tracking and emotional state | |
| WO2016045525A1 (en) | Method and apparatus for processing state of terminal | |
| CN105072264A (en) | Intelligent watch control method and system based on tri-axis accelerometer | |
| CN110677763A (en) | State detection device and earphone | |
| CN111340808A (en) | Screen display monitoring method and device, electronic equipment and storage medium | |
| CN109525837B (en) | Image generation method and mobile terminal | |
| CN109286526A (en) | A kind of wifi system running policy dynamic adjusting method and device | |
| CN108920047A (en) | A kind of control method of application program, terminal and computer readable storage medium | |
| CN111325058B (en) | Driving behavior detection method, device, system and storage medium | |
| CN113591666A (en) | Control method and device applied to mobile phone, computer readable medium and mobile phone | |
| KR101467916B1 (en) | Monitering System of Attemptor to hang and Method thereof | |
| CN107437018B (en) | Mobile terminal, control method thereof, and computer-readable storage medium | |
| CN108597168A (en) | Security alarm method, apparatus based on optical filter and household appliance | |
| CN106774841B (en) | Intelligent glasses and awakening method and awakening device thereof | |
| CN114051116A (en) | Video monitoring method, device and system for driving test vehicle | |
| CN106325985B (en) | Timer adjusting method and system and mobile terminal | |
| CN112511890A (en) | Video image processing method and device and electronic equipment | |
| CN113439254A (en) | Medical equipment output device control method, monitoring system and monitoring equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |