CN114694360A - Eye using prompting method and device for intelligent terminal, intelligent terminal and storage medium - Google Patents

Abstract

The invention discloses an eye prompting method, device, intelligent terminal and storage medium for an intelligent terminal. The method includes: acquiring face image information, and determining a movie viewing state of the face image according to the face image information; According to the viewing state, the eye care mode is determined; according to the eye care mode, the eye prompt information corresponding to the eye care mode is determined. The embodiment of the present invention adjusts the distance and eccentric angle of the user's movie viewing by the above method, and prompts the user to perform the action of the health care video after the viewing time reaches a certain period of time, thereby protecting the user's eyesight.

Description

Eye prompting method, device, intelligent terminal, and storage medium of intelligent terminal

technical field

The present invention relates to the technical field of smart TVs, and in particular, to a method, device, smart terminal and storage medium for prompting with eyes of a smart terminal.

Background technique

In recent years, due to the continuous development and popularization of smart TVs, with the diversification of TV programs, the interest of smart interaction has increased, and the appeal of smart TVs has become more and more attractive, especially for children who are curious and entertaining. to say. Moreover, users usually approach the screen unknowingly and maintain a posture for a long time because of the input of watching TV programs, which is very detrimental to eyesight and physical health.

Therefore, the existing technology still needs to be improved and developed.

SUMMARY OF THE INVENTION

The technical problem to be solved by the present invention is that, aiming at the above-mentioned defects of the prior art, an eye prompting method for an intelligent terminal is provided, which aims to solve the problem that in the prior art, users usually approach the TV program unknowingly because of their investment in watching TV programs. Screen, watching TV at a certain angle and keeping one posture for a long time to watch TV are very detrimental to eyesight and physical health.

The technical scheme adopted by the present invention to solve the problem is as follows:

In a first aspect, an embodiment of the present invention provides an eye prompting method for an intelligent terminal, wherein the method includes:

Obtaining face image information, and determining the movie viewing state of the face image according to the face image information;

According to the movie viewing state, determine the eye care mode;

According to the eye care mode, eye care prompt information corresponding to the eye care mode is determined.

In an implementation manner, the obtaining face image information includes:

Collect surrounding images within a preset range;

According to the surrounding environment image, face image information in the surrounding environment image is determined.

In an implementation manner, the determining of the face image information according to the surrounding environment image includes:

matching the surrounding environment image with a preset face picture;

When the matching degree between the surrounding environment image and the preset face picture satisfies the preset value, it is determined that the matching is successful;

When the matching is successful, the face image information in the surrounding environment image is acquired.

In an implementation manner, the determining the movie viewing state of the face image according to the face image information includes:

According to the face image information, determine the orientation information of the face image;

According to the face image information, the viewing duration of the face image is determined.

In an implementation manner, the determining the orientation information of the face image according to the face image information includes:

According to the face image information, determine the position of the face image;

According to the position, the distance and the included angle between the face image and the smart terminal are determined.

In an implementation manner, wherein, determining the viewing duration of the face image according to the face image information includes:

When the face image information is detected, start the viewing timer and time it to obtain the timing time of the viewing timer;

The timing time is used as the viewing time of the face image.

In an implementation manner, wherein, determining the eye care mode according to the movie viewing state includes:

When the distance is not within the preset distance range or the included angle is not within the preset angle range, enter the first eye care mode;

When the viewing time reaches a preset time, the second eye care mode is entered.

In an implementation manner, wherein, according to the eye care mode, determining the eye use prompt information corresponding to the eye care mode includes:

When the eye care mode is the first eye care mode, the first eye care prompt information is sent; wherein, the first eye care prompt information includes a reminder to play a health care video and a reminder to the user to adjust the viewing distance and watch movies angle;

When the eye care mode is the second eye care mode, the second eye care prompt information is sent; wherein the second eye care prompt information includes actions of reminding to play the health care video and reminding the user to execute the health care video .

In a second aspect, an embodiment of the present invention further provides an eye prompting device for an intelligent terminal, wherein the device includes:

an orientation information and viewing duration acquisition unit, used to obtain orientation information and viewing duration of the face image;

an eye care mode determination unit, configured to determine an eye care mode according to the orientation information and the viewing duration;

A health care operation determining unit, configured to determine a health care operation corresponding to the eye care mode according to the eye care mode.

In a third aspect, an embodiment of the present invention further provides an intelligent terminal, including a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors The one or more programs include an eye prompting method for executing the smart terminal described in any one of the above.

In a fourth aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can execute any of the above The eye prompting method of the intelligent terminal described above.

Beneficial effects of the present invention: the embodiment of the present invention first obtains face image information, and determines the viewing state of the face image according to the face image information; then determines the eye care mode according to the viewing state; The eye care mode determines the eye prompt information corresponding to the eye care mode; it can be seen that the embodiment of the present invention adjusts the distance and eccentric angle of the user's viewing of the movie through the above method, and the viewing time reaches a certain period of time. The user is prompted to do the action of the health care video, thereby protecting the user's eyesight.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments described in the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

1 is a schematic flowchart of a method for prompting with eyes of an intelligent terminal according to an embodiment of the present invention

FIG. 2 is a schematic block diagram of an eye prompting device for an intelligent terminal provided by an embodiment of the present invention.

FIG. 3 is a schematic block diagram of an internal structure of an intelligent terminal provided by an embodiment of the present invention.

Detailed ways

The present invention discloses an eye prompting method, device, smart terminal, and storage medium for an intelligent terminal. In order to make the purpose, technical solution and effect of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

It will be understood by those skilled in the art that the singular forms "a", "an", "the" and "the" as used herein can include the plural forms as well, unless expressly stated otherwise. It should be further understood that the word "comprising" used in the description of the present invention refers to the presence of stated features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components and/or groups thereof. It will be understood that when we refer to an element as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Furthermore, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combination of one or more of the associated listed items.

It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It should also be understood that terms, such as those defined in a general dictionary, should be understood to have meanings consistent with their meanings in the context of the prior art and, unless specifically defined as herein, should not be interpreted in idealistic or overly formal meaning to explain.

In the prior art, users usually approach the screen unknowingly, watch TV from a certain angle, and watch TV in one posture for a long time because of their investment in watching TV programs, which is very detrimental to eyesight and physical health.

In order to solve the problems in the prior art, the present embodiment provides a method for prompting with eyes of an intelligent terminal. Through the above method, the user's viewing state can be reasonably adjusted, thereby protecting the user's eyes. In the specific implementation, the intelligent terminal system first obtains the face image information, and determines the movie viewing state of the face image according to the face image information. The motion state of the TV can also be the user watching TV in dim light, there is no specific restriction, and then according to the user's viewing state, the eye care mode is determined, and finally the intelligent terminal system can give the corresponding eye care mode. eye prompt information. In this embodiment, the smart terminal system is a smart TV control system.

for example

Family members, especially children, tend to stay in one position for a long time due to too much concentration when watching children's TV programs, or walk in front of the TV unknowingly, or stand on the side of the TV screen. Affects children's vision. If children's vision is damaged at a very young age, it is difficult to correct it when they grow up. The eye prompting method of the intelligent terminal of the present invention can well prompt children to pay attention to eye safety. In this embodiment, the television system first obtains the face image information, and then determines the viewing state of the face image according to the identified face image information. If the child is watching TV, the identified face image is the child's face image. , it is also possible to obtain the children's viewing status, and determine the eye care mode according to the children's different viewing states. The information performs the corresponding action and ultimately protects the child's vision.

Exemplary method

This embodiment provides an eye prompting method for an intelligent terminal, and the method can be applied to an image processing intelligent terminal. Specifically, as shown in Figure 1, the method includes:

Step S100, obtaining face image information, and determining the movie viewing state of the face image according to the face image information;

Specifically, at the front end of the TV, there are many objects, and it is necessary to distinguish whether it is a face image or an object. If it is an object, it is unnecessary to pay attention to the information of the face image, so as to monitor the viewing state of the face image.

In order to obtain face image information, the obtaining face image information includes the following steps:

Step S101, collecting images of the surrounding environment within a preset range;

Step S102: Determine the face image information in the surrounding environment image according to the surrounding environment image.

In practice, people watching TV must be sitting within a certain range in front of the TV screen, so the TV system only needs to collect the surrounding environment images within this range, that is, the TV system collects the surrounding environment images within the preset range. The surrounding environment image contains face images and other things, such as images of cabinets, sofas, coffee tables, etc. Therefore, it is necessary to determine the face image information in the surrounding environment images according to the surrounding environment images.

In order to obtain the face image information, determining the face image information according to the surrounding environment image includes the following steps: matching the surrounding environment image with a preset face picture; If the matching degree of the face picture satisfies the preset value, it is determined that the matching is successful; when the matching is successful, the face image information in the surrounding environment image is acquired.

In practice, the surrounding environment image is matched with the preset face picture. When the matching degree between the person image in the surrounding environment image and the pre-stored face picture is very high, that is, the preset matching value is reached, then The matching is determined, and when the matching is successful, the face image information in the surrounding environment image can be acquired. For example, the TV control system obtains the first frame of photo image information collected by the camera of the TV, detects the face image of the input image, and classifies each block in the image by training the cascade classifier. It is judged as a face image, and the face image information is saved to generate a face pattern code. By comparing the similarity with the pre-established face image file, the currently obtained face pattern code is compared with the face pattern in the archive. The code is retrieved and compared to determine whether it is true. If it is true 1, that is, the similarity of the facial texture coding is > 80%, and the flag is set to 1. If it is false, it is 0, that is, the similarity of the facial texture coding is < 80%.

In order to obtain the viewing state of the human face image, determining the viewing state of the human face image according to the human face image information includes the following steps: determining the orientation information of the human face image according to the human face image information ; According to the face image information, determine the viewing duration of the face image.

In practice, after identifying the face image information in the surrounding environment, the orientation information of the face image and the viewing time can be determined through the positioning system. In an implementation manner, the position of the face image is determined according to the face image information; the distance and the included angle between the face image and the smart terminal are determined according to the position. For example: after the smart TV control system obtains the face image information, it determines the position of the face image, obtains the angle between the face and the camera, and the scanning angle range is 0~180 degrees. The right side of the center horizontal position is set to the right end, and then the angle between the user and the screen is calculated. In addition, the smart TV control system obtains the value of the vertical distance between the child and the screen obtained by using the angle cosine value, the specific range is 0-10 meters, and the smart TV control system calculates the distance between the child and the screen. In another implementation manner, when the face image information is detected, a movie viewing timer is started and counted to obtain the timing time of the movie viewing timer; the timing time is used as the viewing duration of the face image. In practice, once the smart TV control system detects the face image information, it starts the movie viewing timer inside the system and starts timing, the smart TV control system will monitor the timing time of the viewing timer in real time, and will The time counted by the timer is the length of time that the current face image is watched on the smart TV. For example: the smart TV control system obtains the total time that the user watches the current program, and then obtains the program type recorded in the current time period in the background, and classifies the program type: the label of the movie is 1, the label of the variety show is 2, and the label of the online course It is 3, and the label of the TV series is 4. After the smart TV control system obtains the program type in the current time, the smart TV control system recommends the time for doing health care animation corresponding to each program type. When the smart TV control system obtains the program type identifier is 1. , corresponding to movies, the recommended health care animation time is the end of a movie, and the total length of the movie is obtained as the reference time; the smart TV control system obtains the program type identifier as 2, corresponding to variety shows, and the recommended health care animation time is 1 hour; The TV control system obtains that the program type identifier is 3, the online class, and the recommended health care animation time is at the end of a class. Specifically, it obtains the playing time of each class of the online class as the reference time. If the time is less than 45 minutes, then the cumulative network The number of online classes with class time > 45 is taken as the final time; the smart TV control system obtains that the program type identifier is 4, the TV drama, and the recommended health care animation time is the end of an episode of TV drama. The base time, if the time is less than 45 minutes, the number of online class periods of 45 <online class time> 1 hour will be accumulated as the final time.

This embodiment provides an eye prompting method for an intelligent terminal, and the method can be applied to an image processing intelligent terminal. Specifically, as shown in Figure 1, the method includes:

Step S200, determining an eye care mode according to the movie viewing state;

According to the viewing state, that is, determine the eye care mode corresponding to the distance and angle between the user and the smart terminal, and the eye care mode corresponding to the user's viewing time. The content included is different, and the role it plays is also different.

In order to obtain the eye care mode, determining the eye care mode according to the movie viewing state includes:

Step S201, when the distance is not within the preset distance range or the included angle is not within the preset angle range, enter the first eye care mode;

Step S202, when the viewing duration reaches a preset time, enter the second eye care mode.

When the distance between the user and the TV is not within the preset distance range, or the angle between the user and the TV is not within the preset range, it means that the user is watching TV incorrectly and needs to be adjusted. At this time, the first eye care mode is entered. In addition, when the user watches TV for a long time beyond the specified time, watching TV in the long run will inevitably have a negative impact on the body, indicating that the user needs to exercise the muscles and bones at this time, and then enter the second eye care mode. For example: the smart TV control system obtains the posture angle between the user and the smart TV. If the angle is greater than the animation angle posture, the user is reminded to adjust the angle until the preset value is met. The control system obtains whether the distance between the user and the smart TV control system is consistent with the distance value in the storage. If the distance between the user and the smart TV control system > the distance value in the storage, there is no need to remind, if the distance between the user and the smart TV control system < storage The distance value in the device reminds the user to adjust the distance.

This embodiment provides an eye prompting method for an intelligent terminal, and the method can be applied to an image processing intelligent terminal. Specifically, as shown in Figure 1, the method includes:

Step S300 , according to the eye care mode, determine eye use prompt information corresponding to the eye care mode.

In practice, after the eye care mode is determined, the eye prompt information corresponding to the eye care mode can be determined, that is, the prompt information corresponding to the first eye care mode and the second eye care mode are different. Remind the user to take different health care methods to better protect the user's eyes.

In order to obtain the eye-use prompt information corresponding to the eye-use health care mode, determining the eye-use prompt information corresponding to the eye-use health care mode according to the eye use care mode includes the following steps:

Step S301, when the eye health care mode is the first eye care mode, send the first eye use prompt information; wherein the first eye use prompt information includes reminding to play the health care video and reminding the user to adjust the viewing distance and viewing angle;

Step S302, when the eye care mode is the second eye care mode, send second eye care prompt information; wherein the second eye prompt information includes reminding to play a health care video and reminding the user to perform the health care Video action.

In this embodiment, when the eye care mode is the first eye care mode, it means that the user's posture for watching TV is incorrect. At this time, from the perspective of protecting the user's eyesight, the user is reminded to adjust the viewing distance and viewing distance. It also reminds users to play health care videos and let users do some activity. When the eye care mode is the second eye care mode, it means that the user has been watching TV for too long, which affects the user's eyes and body. Therefore, from the perspective of protecting the user's eyesight and body, the user is required to move their body. Therefore, it reminds to play the health care video, and reminds the user to imitate according to the actions of the health care video. For example: if multiple close-range or off-angle viewing images of the same user are captured during the set time period, the current video will be paused, the health-care video will be played, the user will be prompted to adjust the distance and angle, and the health-care action will be imitated according to the video operation. Continue to play the previous movie. When it is captured that the user is still watching the current video for more than the preset time, the health care video will be opened, and the health care video will be reminded to play, and the user will be reminded to imitate the actions in the health care video. Play the previous movie. At the same time, record the number and time of health care video playback in one day (within 12 hours), and save it to the cloud server as a historical record after completion.

Exemplary Equipment

As shown in FIG. 2 , an embodiment of the present invention provides an eye prompting device for a smart terminal, the device includes an orientation information and movie viewing duration acquisition unit 401, an eye care mode determination unit 402, and a health care operation determination unit 403; wherein :

an orientation information and viewing duration obtaining unit 401, used for acquiring orientation information and viewing duration of the face image;

an eye care mode determination unit 402, configured to determine an eye care mode according to the orientation information and the viewing duration;

The health care operation determining unit 403 is configured to determine the health care operation corresponding to the eye care mode according to the eye care mode.

Based on the above embodiments, the present invention also provides an intelligent terminal, the principle block diagram of which may be shown in FIG. 3 . The intelligent terminal includes a processor, a memory, a network interface, a display screen, and a temperature sensor connected through a system bus. Wherein, the processor of the intelligent terminal is used to provide computing and control capabilities. The memory of the intelligent terminal includes a non-volatile storage medium and an internal memory. The nonvolatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the execution of the operating system and computer programs in the non-volatile storage medium. The network interface of the intelligent terminal is used for communicating with external terminals through network connection. When the computer program is executed by the processor, an eye prompting method for an intelligent terminal is realized. The display screen of the smart terminal may be a liquid crystal display screen or an electronic ink display screen, and the temperature sensor of the smart terminal is pre-set inside the smart terminal to detect the operating temperature of the internal equipment.

Those skilled in the art can understand that the schematic diagram in FIG. 3 is only a block diagram of a partial structure related to the solution of the present invention, and does not constitute a limitation on the intelligent terminal to which the solution of the present invention is applied. The specific intelligent terminal may include There are more or fewer components than shown in the figures, or some components are combined, or have a different arrangement of components.

In one embodiment, an intelligent terminal is provided that includes a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors One or more programs contain instructions to:

Obtaining face image information, and determining the movie viewing state of the face image according to the face image information;

According to the movie viewing state, determine the eye care mode;

According to the eye care mode, eye care prompt information corresponding to the eye care mode is determined.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other medium used in the various embodiments provided by the present invention may include non-volatile and/or volatile memory. Nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Road (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

In summary, the present invention discloses an eye prompting method, device, intelligent terminal and storage medium for an intelligent terminal. The method includes: acquiring face image information, and determining a face image according to the face image information According to the viewing state, the eye care mode is determined; according to the eye care mode, the eye prompt information corresponding to the eye care mode is determined. The embodiment of the present invention adjusts the distance and eccentric angle of the user's viewing of the movie through the above method, and prompts the user to perform the action of the health care video after the viewing time reaches a certain period of time, thereby protecting the user's eyesight.

It should be understood that the present invention discloses an eye prompting method for an intelligent terminal. It should be understood that the application of the present invention is not limited to the above examples. For those of ordinary skill in the art, improvements or transformations can be made according to the above descriptions. , all these improvements and transformations should belong to the protection scope of the appended claims of the present invention.

Claims (11)

1. An eye using prompting method of an intelligent terminal is characterized by comprising the following steps:

acquiring face image information, and determining the film watching state of a face image according to the face image information;

determining an eye health care mode according to the film watching state;

and determining the eye use prompting information corresponding to the eye use health care mode according to the eye use health care mode.

2. The method for prompting using eyes of the intelligent terminal according to claim 1, wherein the obtaining the face image information comprises:

collecting surrounding environment images within a preset range;

and determining face image information in the surrounding environment image according to the surrounding environment image.

3. The method for prompting by eye of the intelligent terminal according to claim 2, wherein the determining the face image information according to the surrounding environment image comprises:

matching the surrounding environment image with a preset human face image;

when the matching degree of the surrounding environment image and a preset face picture meets a preset value, determining that the matching is successful;

and when the matching is successful, acquiring the face image information in the surrounding environment image.

4. The eye prompting method of the intelligent terminal according to claim 2, wherein the determining the viewing state of the face image according to the face image information comprises:

determining the azimuth information of the face image according to the face image information;

and determining the film watching duration of the face image according to the face image information.

5. The method for prompting by eye of the intelligent terminal according to claim 4, wherein the determining the orientation information of the face image according to the face image information comprises:

determining the position of the face image according to the face image information;

and determining the distance and the included angle between the face image and the intelligent terminal according to the position.

6. The eye prompting method of the intelligent terminal according to claim 5, wherein the determining the film watching duration of the face image according to the face image information comprises:

when the face image information is detected, starting a film watching timer and timing to obtain the timing time of the film watching timer;

and taking the timing time as the film watching duration of the face image.

7. The method for prompting using eyes of the intelligent terminal according to claim 6, wherein the determining the health care mode using eyes according to the viewing state comprises:

when the distance is not within the preset distance range or the included angle is not within the preset angle range, entering a first eye care mode;

and when the film watching duration reaches the preset time, entering a second eye health care mode.

8. The method for prompting with eyes of the intelligent terminal according to claim 7, wherein the determining the eye use prompting information corresponding to the eye use health care mode according to the eye use health care mode comprises:

when the eye health care mode is the first eye health care mode, sending first eye prompt information; the first eye prompting information comprises a health-care video reminding function and a video watching function, wherein the health-care video reminding function is used for reminding a user of playing a health-care video and reminding the user of adjusting a film watching interval and a film watching angle;

when the eye-using health-care mode is the second eye-using health-care mode, sending second eye prompting information; and the second eye prompting information comprises actions of prompting to play the health-care video and prompting the user to execute the health-care video.

9. An intelligent terminal's suggestion device of using eyes, its characterized in that, the device includes:

the direction information and film viewing duration acquiring unit is used for acquiring the direction information and the film viewing duration of the face image;

the eye health care mode determining unit is used for determining an eye health care mode according to the direction information and the film watching duration;

and the health care operation determining unit is used for determining the health care operation corresponding to the eye health care mode according to the eye health care mode.

10. An intelligent terminal comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and wherein the one or more programs being configured to be executed by the one or more processors comprises instructions for performing the method of any of claims 1-8.

11. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method of any of claims 1-8.

Images