WO2020024416A1

WO2020024416A1 - Anti-peep method and apparatus for smart terminal, computer device and storage medium

Info

Publication number: WO2020024416A1
Application number: PCT/CN2018/108032
Authority: WO
Inventors: 陈颖聪
Original assignee: 平安科技（深圳）有限公司
Priority date: 2018-08-01
Filing date: 2018-09-27
Publication date: 2020-02-06
Also published as: CN109033901A

Abstract

The present application proposes an anti-peep method and apparatus for a smart terminal, a computer device and a storage medium. The method comprises: acquiring an image of a face which is in front of the screen of a smart terminal; determining whether the facial image is consistent with a preset facial template; if not, determining whether the relative position between the eye pupils in the facial image and the screen satisfies a preset condition; if the preset condition is satisfied, determining whether a visual gazing point falls within the screen; if the visual gazing point falls within the screen, controlling the brightness of the visual focus area in the screen to be dim.

Description

Anti-peeping method and device for intelligent terminal, computer equipment and storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on August 1, 2018, with application number 2018108652976, and entitled "Anti-Peeping Method, Device, Computer Equipment, and Storage Medium for Smart Terminals", the entire contents of which Incorporated by reference in this application.

Technical field

The present application relates to the technical field of smart terminals, and in particular, to a method, a device, a computer device, and a storage medium for anti-peeping of a smart terminal.

Background technique

With the development of intelligent technology, the functions of smart terminals are becoming more and more powerful and extensive. For example, people can use their smartphones or iPads to work at anytime and anywhere, such as sending and receiving emails, processing data, and so on. At the same time, there are risks. If you handle confidential events outdoors, it is easy to cause information leakage because others are on the side. There are also people who like to read novels and videos as a pastime. If you watch novels or videos in public, you are often worried about someone. Peeping around, or when using a smart terminal to enter a password for a transaction, it will be peeped by others and then the password will be leaked. Therefore, a method to prevent peeping when using a smart terminal is urgently needed.

technical problem

The main purpose of the present application is to provide an anti-peeping method, device, computer equipment, and storage medium for a smart terminal with high accuracy for judging peepers.

Technical solutions

In order to achieve the above-mentioned object of the present application, the present application proposes an anti-peeping method for a smart terminal, including:

Capture the face image in front of the screen of the smart terminal;

Determining whether the face image is consistent with a face template preset by the smart terminal;

If the face image is inconsistent with a face template preset by the smart terminal, determining whether a relative position of an eye pupil in the face image and a screen of the smart terminal meets a preset condition;

If the relative position of the eye pupil in the face image and the screen of the smart terminal satisfies a preset condition, determining whether the visual fixation point of the eye pupil falls within the screen of the smart terminal;

If the visual fixation point falls within the screen of the smart terminal, the brightness of the visual focus area in the screen is controlled to be dimmed according to the visual fixation point.

Further, the step of determining whether the relative position of the eye pupil in the face image and the screen of the smart terminal satisfies a preset condition includes:

Acquiring position information of the eye pupil;

Analyzing the coordinate value of the eye pupil in a screen coordinate system according to the position information of the eye pupil, wherein the screen coordinate system is a three-dimensional coordinate system with a screen center as an origin;

Determining whether the coordinate value of the eye pupil is within a preset coordinate value range;

If yes, it is determined that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition.

Further, before the step of determining whether the coordinate value of the eye pupil is within a preset coordinate value range, the method includes:

Acquiring a critical position visible to the screen of the smart terminal;

Labeling the critical position in the screen coordinate system to obtain a critical coordinate value;

Setting the preset coordinate value range according to the critical coordinate value.

Further, the step of controlling the brightness of the visual focus area in the screen to be dimmed according to the visual fixation point includes:

Acquiring a position where the visual fixation point falls on the screen, and forming the visual focus area within a preset range of the position;

Controlling the brightness of the visual focus area to be dimmed.

Further, after the step of dimming the brightness of the visual focus area in the screen according to the visual fixation point, the method includes:

Trigger an alert command;

An alert response is made according to the alert instruction.

Further, the step of collecting a face image in front of the screen of the smart terminal includes:

Detecting whether there is a human face in front of the screen of the smart terminal within a preset time interval;

If yes, a face image corresponding to the face is collected.

Further, before the step of collecting a face image in front of the screen of the smart terminal, the method includes:

Collecting face information of a face image currently preset by the smart terminal;

The face information is processed to obtain a face template for comparison with the face image.

This application also provides an anti-peeping device for a smart terminal, including:

An acquisition module for acquiring a face image in front of a screen of a smart terminal;

A first determining module, configured to determine whether the face image is consistent with a face template preset by the smart terminal;

A second determining module, configured to determine that when the face image is inconsistent with a face template preset by the smart terminal, determine whether the relative position of the eye pupil in the face image and the screen of the smart terminal satisfies a preset Set conditions

A third determining module, configured to determine that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition, and then determine whether the visual fixation point of the eye pupil falls on the screen of the smart terminal Inside;

A control module, configured to control the brightness of the visual focus area in the screen to be dimmed according to the visual fixation point when the visual fixation point falls within the screen of the smart terminal.

The present application also provides a computer device including a memory and a processor. The memory stores computer-readable instructions, and the processor implements the steps of the foregoing method when the processor executes the computer-readable instructions.

The present application also provides a computer non-volatile readable storage medium on which computer-readable instructions are stored, and the computer-readable instructions implement the steps of the foregoing method when executed by a processor.

Beneficial effect

Through the above methods, users can use the smart terminal with peace of mind, without worrying about the content they are watching being peeped by others. When the screen of the smart terminal is peeped, the screen of the smart terminal will be displayed in different ways to prevent others from peeping. Remind users.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of steps of an anti-peeping method of a smart terminal according to an embodiment of the present application; FIG.

2 is a schematic block diagram of a structure of an anti-peeping device of a smart terminal according to an embodiment of the present application;

3 is a schematic block diagram of a structure of a second judgment module according to an embodiment of the present application;

FIG. 4 is a schematic block diagram of a computer device according to an embodiment of the present application.

The implementation, functional features and advantages of the purpose of this application will be further described with reference to the embodiments and the drawings.

Best Mode of the Invention

It should be understood that the specific embodiments described herein are only used to explain the application, and are not used to limit the application.

Referring to FIG. 1, a method for preventing peeping of a smart terminal in this embodiment includes:

Step S1: Collect a face image in front of the screen of the smart terminal;

Step S2: determine whether the face image is consistent with a face template preset by the smart terminal;

Step S3: if the face image does not match the face template preset by the smart terminal, determine whether the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition;

Step S4: if the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition, determine whether the visual fixation point of the eye pupil falls within the screen of the smart terminal;

Step S5: If the visual fixation point falls within the screen of the smart terminal, the brightness of the visual focus area in the screen is dimmed according to the visual fixation point.

In this embodiment, the above-mentioned smart terminal has a screen and a front camera, such as a smart phone, an iPad, etc. When using the above-mentioned smart terminal, in order to prevent the screen of the smart terminal from being peeped, an anti-peeping mode can be turned on to prevent the user from currently Reading material was peeped.

Specifically, the face image in front of the screen of the current smart terminal can be collected through the front-facing camera. The face image can include static images of faces at different positions and dynamic images of faces. After collecting these image information, The face recognition is performed through face recognition technology, that is, whether the face image is consistent with a face template preset by a smart terminal. For example, using feature vector method for face recognition, the image information is preprocessed first. , Such as performing light compensation, grayscale transformation, histogram equalization, normalization, geometric correction, filtering, and sharpening on the face image, and then performing feature extraction on the processed face image, the specific process is Obtain the facial features such as eye iris, nose wing, mouth corner and other facial features such as size, position, distance and other attributes, and then calculate their geometric feature quantities, and these feature quantities form a feature vector describing the face image, and then the face image The feature vector of the image is compared with a preset face image feature vector. The preset face image feature vector is the face model. The preset feature vector of the face image is obtained by processing the currently preset face information of the smart terminal. The processing method is the same as the above specific process. When the feature vector of the face image matches the preset feature vector of the face image, it is obtained. The face image is consistent with the preset face template, which means that the preset face template is detected, indicating that no one is peeping. At this time, the smart terminal does not respond. This application does not limit the specific method of face recognition. As long as the face recognition can determine whether the collected face image is a face template currently preset by the smart terminal, it is sufficient. The above-mentioned preset face template may be owned by the owner of the smart terminal or may be a temporary owner. It is only necessary to preset a face template that is currently required for comparison and identification before use.

It can be understood that the face images collected above are not limited to one. That is, multiple face information can be collected at the same time through the above steps, and then the multiple face information is processed and compared with preset face templates respectively, and finally the comparison result is obtained.

In step S3, if the feature vector of the face image does not match the preset feature vector of the face image, that is, the face image does not match the face template preset by the smart terminal, it indicates that the face image is not a smart terminal. The current preset face image is likely to be peeped on the screen, and the prerequisite for being peeped is that someone's eyes can see the screen of the smart terminal. If the eyes of the person are outside the visible range of the screen, then Even if it is recognized that the aforementioned face image is not the current preset face image, there is no need to prevent being peeped. To determine whether the eye pupil is outside the visible range of the screen, you need to know the position relationship between the eye pupil and the screen, that is, you can determine by the relative position of the eye pupil and the screen. Therefore, it is recognized that the aforementioned face image is not the current preset. After the face image, it is necessary to determine whether the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition, and then to know whether the eye pupil is within the visible range of the screen. If the preset condition is satisfied, the eye pupil is indicated. The screen may be peeped if it is within the visible range of the screen.

In step S4, it is further determined whether the visual fixation point falls within the screen of the smart terminal. Specifically, the visual fixation point of the eye pupil is first extracted, and the pupil-corneal reflection vector in the gaze tracking technology can be used to extract the visual fixation point. This technology is an existing technology, and is not repeated here. After extracting the visual fixation point in the eye pupil, it is determined whether the visual fixation point falls within the screen. In step S5, if it is determined that the fixation point falls within the screen of the smart terminal , The screen is being peeped. The above method judges whether to be peeped through the combined judgment of the position of the eye pupil and the visual fixation point, so that the judgment result obtained is more accurate, and a single judgment based on the position of the eye pupil or the visual fixation point is avoided to generate a false judgment. When judged to be peeped, the brightness of the visual focus area in the screen can be controlled from bright to dark, so that the peeper cannot see the screen content.

In one embodiment, the above step S3 includes:

Step S30: acquiring position information of the eye pupil;

Step S31: Analyze the coordinate value of the eye pupil in the screen coordinate system according to the position information of the eye pupil, where the screen coordinate system is a three-dimensional coordinate system with the screen center as the origin;

Step S32: determine whether the coordinate value of the eye pupil is within a preset coordinate value range;

Step S33: If yes, determine that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition.

In this embodiment, the position information of the eye pupil is acquired. Specifically, the image of the eye pupil is obtained by taking a front camera, extracting feature points from the image, and constructing a three-dimensional space based on the feature points to convert the captured two-dimensional picture. Create a three-dimensional picture, establish an effective imaging model through camera calibration, and solve the internal and external parameters of the camera, so that the pixel coordinate system of the image constructed from the above images can be converted into the camera coordinate system, and then the position of the eye pupil is marked on In this camera coordinate system, position information of the eye pupil in the camera coordinate system is obtained. In step S31, since the relative position of the eye pupil and the screen needs to be known, it is used to determine whether the eye pupil is within the visible range of the screen, and the visible range of the screen is the spatial range in which the eye can see the screen. Create a screen coordinate system, and set the visible range within the preset coordinate range in this coordinate system. Specifically, the above screen coordinate system may be a three-dimensional coordinate system with the center of the screen as the origin, the plane on which the vertical screen is located as the Z axis, and the directions of the two sides of the screen that are perpendicular to each other as the x axis and the y axis. The position of the camera and the screen is fixed, so the camera coordinate system can be converted to the screen coordinate system. If the coordinate value of the eye pupil in the camera coordinate system is determined, the coordinate value of the camera in the screen coordinate system can be determined, and the eye pupil can be further judged Whether the coordinate value of is within the preset coordinate value range, if yes, it means that the eye pupil is within the visible range of the screen. If it is determined that the coordinate value of the eye pupil is not within the above-mentioned preset coordinate value range, it means that the eye pupil is not within the visible range of the screen.

In one embodiment, before step S32, the method includes:

Step S320: acquiring a critical position visible to the screen of the smart terminal;

Step S321: mark the critical position in the screen coordinate system to obtain a critical coordinate value;

Step S322: Set the preset coordinate value range according to the critical coordinate value.

In this embodiment, the preset coordinate value can be obtained in the following manner: first obtain a critical position visible to the screen of the smart terminal, that is, obtain a critical point where the screen can be seen at different angles and different positions, and then in the screen coordinate system The critical coordinate values of these critical points are marked in the method to set a preset coordinate value range according to the critical coordinate value. Specifically, the preset coordinate value range can be obtained through a large number of tests. In the above screen coordinate system, for the screen from The test is performed at different positions at different angles to obtain a critical position where the screen can be seen, and the position is marked in the screen coordinate system, and then a range of preset coordinate values is set according to the coordinate values.

In one embodiment, the above step S5 includes:

Step S50: acquiring a position where the visual fixation point falls on the screen, and forming the visual focus area within a preset range of the position;

Step S50: controlling the brightness of the visual focus area to be dimmed.

In this embodiment, the visual focus area is determined by the visual fixation point. Specifically, according to the visual fixation point, a position where the visual fixation point falls on the screen is obtained, and then a visual focus area is formed within a preset range of the position, and The remaining area of the screen is a non-visual focus area. For example, if the visual focus area is set within 2 cm from the visual fixation point, in order to prevent being peeped, the brightness of the screen in this area can be dimmed at this time, even if the user is too late When processing the screen content, the peeper cannot see the screen content. In another embodiment, the content in the visual focus area can be controlled to be turned into a blank page, or garbled characters can be displayed.

In one embodiment, after step S5, the method includes:

Step S6: trigger a warning instruction;

Step S7: Make an alert response according to the alert instruction.

In this embodiment, after the brightness of the visual focus area in the screen is dimmed according to the visual fixation point, an alert instruction is triggered, and then an alert response is made according to the alert instruction. For example, a smart terminal issues a sound alert to remind the user to Ask the user to take countermeasures; or the smart terminal issues a vibration alert to remind the user.

Preferably, the above step S1 includes:

Step S10: detecting whether there is a human face in front of the screen of the smart terminal within a preset time interval;

Step S12: if yes, collect a face image corresponding to the face.

As described in step S10 and step S12 above, the preset time interval can be set by the user. If it is set to 120 seconds, the scene in front of the screen is captured by the camera every 120 seconds, and then the features are compared to determine the scene. Whether there is a human face, so that the user can set the detection time according to the current environment without saving the power by using the camera frequently. Of course, the front camera of the smart terminal can also be used to continuously monitor the scene in front of the screen. When there are multiple faces, the face images corresponding to the faces are collected to prevent the screen from being peeped in a short time.

In one embodiment, before step S1, the method includes:

Step S01: collecting face information of a face image currently preset by the smart terminal;

Step S02: Process the face information to obtain a face template for comparison with the face image.

In this embodiment, before the anti-peeping mode is enabled on the smart terminal, it is necessary to set the face information used for comparison when performing face contrast recognition, that is, to set the face information of the currently preset face template of the smart terminal. Set the camera to collect the face information that needs a preset face template, and process the face information, that is, to preprocess the image of the face information, such as light compensation, grayscale transformation, and histogram equalization of the face image. Processing such as normalization, normalization, geometric correction, filtering, and sharpening, and then extracting the processed face images for feature extraction: obtaining the size, position, distance and other attributes of facial features such as eye iris, nose, mouth corners, etc. Then calculate their geometric feature quantities. These geometric feature quantities form a feature vector describing the face image. This feature vector is the data used for face recognition, which is equivalent to the face template used for comparison during recognition. , And then store the face template in the smart terminal. When the anti-peeping mode is turned on, the face image currently acquired and processed can be associated with the face image. Face template for comparison.

Referring to FIG. 2, the anti-peeping device of the smart terminal in this embodiment includes:

An acquisition module 100 for acquiring a face image in front of a screen of a smart terminal;

A first determining module 200, configured to determine whether the face image is consistent with a face template preset by the smart terminal;

The second determining module 300 is configured to determine whether the relative position of the pupil in the face image and the screen of the smart terminal is satisfied when the face image is inconsistent with a face template preset by the smart terminal. Preset conditions

The third determining module 400 is configured to determine that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition, and then determine whether the visual fixation point of the eye pupil falls on the smart terminal. Within the screen

The control module 500 is configured to control the brightness of a visual focus area in the screen to be dimmed according to the visual fixation point when the visual fixation point falls within the screen of the smart terminal.

Specifically, the acquisition module 100 may collect a face image in front of the screen of the current smart terminal through the foregoing front camera. The face image may include a static image of a human face at a different position, a dynamic image of a human face, and the like. After the image information, the first judgment module 200 recognizes the aforementioned faces through face recognition technology, and determines whether the face image is consistent with the face template preset by the smart terminal. For example, using feature vector method for face recognition, firstly The above image information is preprocessed, such as light compensation, grayscale transformation, histogram equalization, normalization, geometric correction, filtering, and sharpening of the face image, and then the processed face image is processed. Feature extraction, the specific process is to obtain the size, position, distance and other attributes of facial features such as eye iris, nose, mouth corner and other facial features, and then calculate their geometric feature quantities, and these feature quantities form a feature vector describing the face image , And then compare the feature vector of the face image with a preset feature vector of the face image. The vector is the above-mentioned face template. The preset face image feature vector is processed from the currently preset face information of the smart terminal. The processing method is the same as the specific process described above. When the feature vector of the face image and the preset face image Feature vector matching, that is, the obtained face image is consistent with the preset face template, which means that the preset face template is detected, indicating that no one is peeping, and the smart terminal does not respond at this time, and this application is not limited The specific method of face recognition is as long as it can be determined whether the collected face image is a face template currently preset by the smart terminal through face recognition. The above-mentioned preset face template may be owned by the owner of the smart terminal or may be a temporary owner. It is only necessary to preset a face template that is currently required for comparison and identification before use.

If the feature vector of the face image does not match the preset feature vector of the face image, that is, the face image is inconsistent with the face template preset by the smart terminal, then the face image is not currently preset by the smart terminal Face images are likely to be peeped on the screen, and the prerequisite for being peeped is that other people's eyes can see the screen of the smart terminal. If a person's eyes are outside the visible range of the screen, even if the above is recognized The face image is not the current preset face image, and there is no need to prevent being peeped. To determine whether the eye pupil is outside the visible range of the screen, you need to know the position relationship between the eye pupil and the screen, that is, you can determine by the relative position of the eye pupil and the screen. After the face image, the second judgment module 300 is required to determine whether the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition, and then whether the eye pupil is within the visible range of the screen. Setting conditions indicates that the eye pupil is within the visible range of the screen, and the screen may be peeped.

Further, the third determination module 400 determines whether the visual fixation point falls within the screen of the smart terminal. Specifically, the visual fixation point of the eye pupil is first extracted, and the pupil-corneal reflection vector in the sight tracking technology can be used to extract the vision. Gaze point, this technology is the prior art, and is not repeated here. After extracting the visual fixation point in the eye pupil, determine whether the visual fixation point falls within the screen. If it is determined that the fixation point falls within the screen of the smart terminal, the description is The screen is being peeped. The above method judges whether to be peeped through the combined judgment of the position of the eye pupil and the visual fixation point, so that the judgment result obtained is more accurate, and a single judgment based on the position of the eye pupil or the visual fixation point is avoided to cause misjudgment. When judged to be peeped, the control module 500 can control the brightness of the visual focus area in the screen from bright to dark, so that the peeper cannot see the screen content.

In one embodiment, referring to FIG. 3, the above-mentioned second determination module 300 includes:

A first acquisition submodule 310, configured to acquire position information of the eye pupil;

An analysis sub-module 320 is configured to analyze a coordinate value of the eye pupil in a screen coordinate system according to the position information of the eye pupil, where the screen coordinate system is a three-dimensional coordinate system with a screen center as an origin;

A judging sub-module 330, configured to judge whether the coordinate value of the eye pupil is within a preset coordinate value range;

A determination sub-module 340 is configured to determine that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition when the coordinate value of the eye pupil is within a preset coordinate value range.

In this embodiment, the first acquisition sub-module 310 acquires the position information of the eye pupil. Specifically, the image of the eye pupil is obtained by taking a front camera, extracting feature points from the image, and performing spatial three-dimensional construction according to the feature points. The captured two-dimensional picture is converted into a three-dimensional picture, and an effective imaging model is established by camera calibration, and the internal and external parameters of the camera are solved. In this way, the pixel coordinate system of the image constructed from the above images can be converted into the camera coordinate system, and then The position of the eye pupil is marked in the camera coordinate system, so as to obtain the position information of the eye pupil in the camera coordinate system. Because the relative position of the eye pupil and the screen needs to be known, it is used to determine whether the eye pupil is within the visible range of the screen, and the visible range of the screen is the spatial range in which the eye can see the screen, so a screen coordinate system can be established. The visible range is set in the preset coordinate range in this coordinate system. Specifically, the above screen coordinate system may be a three-dimensional coordinate system with the center of the screen as the origin, the plane on which the vertical screen is located as the Z axis, and the directions of the two sides of the screen that are perpendicular to each other as the x axis and the y axis. The position of the camera and the screen is fixed, so the camera coordinate system can be converted into the screen coordinate system. If the coordinate value of the eye pupil in the camera coordinate system is determined, the coordinate value of the camera in the screen coordinate system can be determined, and then the sub-module 330 can further determine Determine whether the coordinate value of the eye pupil is within a preset coordinate value range, and if it is, it indicates that the eye pupil is within a visible range of the screen. If it is determined that the coordinate value of the eye pupil is not within the above-mentioned preset coordinate value range, it means that the eye pupil is not within the visible range of the screen.

In one embodiment, the second determining module 300 further includes:

A second acquisition submodule, configured to acquire a critical position visible to a screen of the smart terminal;

A labeling submodule, configured to label the critical position in the screen coordinate system to obtain a critical coordinate value;

A setting sub-module is configured to set the preset coordinate value range according to the critical coordinate value.

In this embodiment, the preset coordinate value can be obtained in the following manner: the second acquisition submodule first acquires a critical position visible to the screen of the smart terminal, that is, acquires a critical point where the screen can be seen at different angles and different positions, Then the labeling sub-module labels the critical coordinate values of these critical points in the screen coordinate system, and sets the sub-module to set a preset coordinate value range according to the critical coordinate value. Specifically, the above-mentioned preset coordinate value range can be obtained through a large number of tests. In the above screen coordinate system, the screen is tested from different angles and different positions to obtain the critical position where the screen can be seen, and the position is marked in the screen coordinate system, and then the preset coordinate value is set according to the coordinate value Range.

In one embodiment, the control module 500 includes:

Forming a sub-module for obtaining a position where the visual fixation point falls on the screen, and forming the visual focus area within a preset range of the position;

A control submodule, configured to control the brightness of the visual focus area to be dimmed.

Preferably, the above-mentioned acquisition module 100 includes:

A detection module, configured to detect whether there is a human face in front of the screen of the smart terminal within a preset time interval;

A face module is configured to collect a face image corresponding to the face when a face is detected in front of the screen of the smart terminal.

As described in the above detection module and face module, the preset time interval can be set by the user. If it is set to 120 seconds, the scene in front of the screen is captured by the camera every 120 seconds, and then the scene is judged by feature comparison. Whether there is a human face in the camera, so that the user can set the detection time according to the current environment without saving the camera by using the camera frequently. Of course, the front camera of the smart terminal can also be used to continuously monitor the scene in front of the screen. When a face appears in the scene When there are multiple faces, the face images corresponding to the faces are collected to prevent the screen from being peeped in a short time.

In one embodiment, the above-mentioned anti-peeping device of the smart terminal includes:

A preset module, configured to collect face information of a currently preset face image of the smart terminal;

A processing module is configured to process the face information to obtain a face template for comparison with the face.

In this embodiment, before the anti-peeping mode is enabled on the smart terminal, it is necessary to set the face information used for comparison when performing face contrast recognition, that is, a preset module is required to set the face information of the face template currently preset by the smart terminal. First, the face information of the face template that needs to be preset is collected through the front camera, and the processing module processes the face information, that is, the image of the face information is pre-processed, such as the light compensation and graying of the face image. Degree transformation, histogram equalization, normalization, geometric correction, filtering, and sharpening, etc., and then perform feature extraction on the processed face image: get the size of facial features such as eye iris, nose, mouth corner, etc. Position, distance, and other attributes, and then calculate their geometric feature quantities. These geometric feature quantities form a feature vector describing the face image. The feature vector is the data used for face recognition, which is equivalent to the time of recognition. To compare the face template, and then store the face template in the smart terminal. When the anti-peeping mode is turned on, the current collection and processing can be performed. Face images obtained were compared with the face template.

Referring to FIG. 4, an embodiment of the present application further provides a computer device. The computer device may be a server, and its internal structure may be as shown in FIG. The computer device includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the computer design processor is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer-readable instructions, and a database. The memory provides an environment for operating systems and computer-readable instructions in a non-volatile storage medium. The database of the computer equipment is used to store data such as the anti-peeping method of the intelligent terminal. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer-readable instructions are executed by a processor, an anti-peeping method of an intelligent terminal is implemented.

The processor executes the steps of the anti-peeping method of the smart terminal: collecting a face image in front of the screen of the smart terminal; judging whether the face image is consistent with a face template preset by the smart terminal; if the face image If it is inconsistent with the face template preset by the smart terminal, it is determined whether the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition; if the eye pupil in the face and the If the relative position of the screen of the smart terminal satisfies a preset condition, it is determined whether the visual fixation point of the eye pupil falls within the screen of the smart terminal; if the visual fixation point falls within the screen of the smart terminal, then Controlling the brightness of the visual focus area in the screen to be dimmed according to the visual fixation point.

In the computer device, the step of determining whether a relative position of an eye pupil in the face image and a screen of the smart terminal meets a preset condition includes: obtaining position information of the eye pupil; and according to the position of the eye pupil Information analysis of coordinate values of the eye pupil in a screen coordinate system, wherein the screen coordinate system is a three-dimensional coordinate system with a screen center as an origin; determining whether the coordinate value of the eye pupil is within a preset coordinate value range ; If yes, determine that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition.

In one embodiment, before the step of determining whether the coordinate value of the eye pupil is within a preset coordinate value range, the method includes: obtaining a critical position visible to the screen of the smart terminal; and setting the critical position at Annotate in the screen coordinate system to obtain a critical coordinate value; and set the preset coordinate value range according to the critical coordinate value.

In an embodiment, the step of controlling the brightness of the visual focus area in the screen to be dimmed according to the visual fixation point includes: obtaining a position where the visual fixation point falls on the screen, and at the position The visual focus area is formed within a preset range; the brightness of the visual focus area is controlled to be darkened.

In one embodiment, after the step of dimming the brightness of the visual focus area in the screen according to the visual fixation point, the method includes: triggering an alert instruction; and making an alert response according to the alert instruction.

In one embodiment, before the step of collecting a face image in front of the screen of the smart terminal, the method includes: detecting whether there is a human face in front of the screen of the smart terminal within a preset time interval; if yes, collecting the corresponding face of the face Face image.

In an embodiment, before the step of collecting a face image in front of the screen of the smart terminal, the method includes: collecting face information of a face image currently preset by the smart terminal; and processing the face information, A face template is obtained for comparison with the face image.

Those skilled in the art can understand that the structure shown in FIG. 4 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer equipment to which the solution of the present application is applied.

An embodiment of the present application further provides a computer non-volatile readable storage medium, which stores computer-readable instructions. When the computer-readable instructions are executed by a processor, an anti-peeping method for an intelligent terminal is implemented, specifically: Collect a face image in front of the screen of the smart terminal; determine whether the face image is consistent with a face template preset by the smart terminal; if the face image is inconsistent with a face template preset by the smart terminal, then Determine whether the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition; if the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition, then Determine whether the visual fixation point of the eye pupil falls within the screen of the smart terminal; if the visual fixation point falls within the screen of the smart terminal, control the vision in the screen according to the visual fixation point The focus area becomes darker.

In the computer-readable storage medium, the step of determining whether the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition includes: obtaining position information of the eye pupil; The position information of the pupil analyzes the coordinate value of the eye pupil in a screen coordinate system, where the screen coordinate system is a three-dimensional coordinate system with the screen center as the origin; determining whether the coordinate value of the eye pupil is at a preset coordinate Within the value range; if yes, it is determined that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition.

Those of ordinary skill in the art can understand that all or part of the processes in the method of the above embodiments can be implemented by computer-readable instructions to instruct related hardware. The computer-readable instructions can be stored with a non-volatile computer. In the readable storage medium, the computer-readable instructions, when executed, may include the processes of the embodiments of the methods described above. Wherein, any reference to the memory, storage, database, or other media provided in this application and used in the embodiments may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual-speed data rate SDRAM (SSRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

It should be noted that, in this article, the terms "including", "comprising" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements includes not only those elements, It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, device, article, or method. Without more restrictions, an element limited by the sentence "including a ..." does not exclude that there are other identical elements in the process, device, article, or method that includes the element.

The above is only a preferred embodiment of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the description and drawings of the present application, or directly or indirectly used in other related The technical fields are equally included in the patent protection scope of this application.

Claims

An anti-peeping method for a smart terminal, which includes:

Capture the face image in front of the screen of the smart terminal;

Determining whether the face image is consistent with a face template preset by the smart terminal;

If the face image is inconsistent with a face template preset by the smart terminal, determining whether a relative position of an eye pupil in the face image and a screen of the smart terminal meets a preset condition;

If the relative position of the eye pupil in the face image and the screen of the smart terminal satisfies a preset condition, determining whether the visual fixation point of the eye pupil falls within the screen of the smart terminal;

If the visual fixation point falls within the screen of the smart terminal, the brightness of the visual focus area in the screen is controlled to be dimmed according to the visual fixation point.
The anti-peeping method for a smart terminal according to claim 1, wherein the step of determining whether a relative position of an eye pupil in the face image and a screen of the smart terminal satisfies a preset condition, comprises:

Acquiring position information of the eye pupil;

Analyzing the coordinate value of the eye pupil in a screen coordinate system according to the position information of the eye pupil, wherein the screen coordinate system is a three-dimensional coordinate system with a screen center as an origin;

Determining whether the coordinate value of the eye pupil is within a preset coordinate value range;

If yes, it is determined that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition.
The anti-peeping method for a smart terminal according to claim 2, wherein before the step of determining whether the coordinate value of the eye pupil is within a preset coordinate value range, comprising:

Acquiring a critical position visible to the screen of the smart terminal;

Labeling the critical position in the screen coordinate system to obtain a critical coordinate value;

Setting the preset coordinate value range according to the critical coordinate value.
The anti-peeping method for a smart terminal according to claim 1, wherein the step of controlling the brightness of a visual focus area in the screen to be dimmed according to the visual fixation point comprises:

Acquiring a position where the visual fixation point falls on the screen, and forming the visual focus area within a preset range of the position;

Controlling the brightness of the visual focus area to be dimmed.
The anti-peeping method for a smart terminal according to claim 1, wherein after the step of dimming the brightness of the visual focus area in the screen according to the visual fixation point, comprises:

Trigger an alert command;

An alert response is made according to the alert instruction.
The anti-peeping method for a smart terminal according to claim 1, wherein the step of collecting a face image in front of the screen of the smart terminal comprises:

Detecting whether there is a human face in front of the screen of the smart terminal within a preset time interval;

If yes, a face image corresponding to the face is collected.
The anti-peeping method for a smart terminal according to claim 1, wherein before the step of collecting a face image in front of the screen of the smart terminal, the method comprises:

Collecting face information of a face image currently preset by the smart terminal;

The face information is processed to obtain a face template.
An anti-peeping device for an intelligent terminal, which is characterized by comprising:

An acquisition module for acquiring a face image in front of a screen of a smart terminal;

A first determining module, configured to determine whether the face image is consistent with a face template preset by the smart terminal;

A second determining module, configured to determine that when the face image is inconsistent with a face template preset by the smart terminal, determine whether the relative position of the eye pupil in the face image and the screen of the smart terminal satisfies a preset Set conditions

A third determining module, configured to determine that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition, and then determine whether the visual fixation point of the eye pupil falls on the screen of the smart terminal Inside;

A control module, configured to control the brightness of the visual focus area in the screen to be dimmed according to the visual fixation point when the visual fixation point falls within the screen of the smart terminal.
The anti-peeping device for a smart terminal according to claim 8, wherein the second judging module comprises:

A first acquisition submodule, configured to acquire position information of the eye pupil;

An analysis submodule, configured to analyze the coordinate value of the eye pupil in a screen coordinate system according to the position information of the eye pupil, wherein the screen coordinate system is a three-dimensional coordinate system with the screen center as an origin;

A judging submodule, configured to judge whether the coordinate value of the eye pupil is within a preset coordinate value range;

A determination sub-module is configured to determine that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition when the coordinate value of the eye pupil is within a preset coordinate value range.
The anti-peeping device for a smart terminal according to claim 9, wherein the second determining module comprises:

A second acquisition submodule, configured to acquire a critical position visible to a screen of the smart terminal;

A labeling submodule, configured to label the critical position in the screen coordinate system to obtain a critical coordinate value;

A setting sub-module is configured to set the preset coordinate value range according to the critical coordinate value.
The anti-peeping device for a smart terminal according to claim 8, wherein the control module comprises:

Forming a sub-module for obtaining a position where the visual fixation point falls on the screen, and forming the visual focus area within a preset range of the position;

A control submodule, configured to control the brightness of the visual focus area to be dimmed.
The anti-peeping device for a smart terminal according to claim 8, wherein the acquisition module comprises:

A detection module, configured to detect whether there is a human face in front of the screen of the smart terminal within a preset time interval;

A face module is configured to collect a face image corresponding to the face when a face is detected in front of the screen of the smart terminal.
The anti-peeping device for a smart terminal according to claim 8, further comprising:

A preset module, configured to collect face information of a currently preset face image of the smart terminal;

A processing module, configured to process the face information to obtain a face template.
A computer device includes a memory and a processor. The memory stores computer-readable instructions, and is characterized in that the processor implements an anti-peeping method of a smart terminal when the processor executes the computer-readable instructions, and Peeping methods include:

Capture the face image in front of the screen of the smart terminal;

Determining whether the face image is consistent with a face template preset by the smart terminal;

If the face image is inconsistent with a face template preset by the smart terminal, determining whether a relative position of an eye pupil in the face image and a screen of the smart terminal meets a preset condition;

If the relative position of the eye pupil in the face image and the screen of the smart terminal satisfies a preset condition, determining whether the visual fixation point of the eye pupil falls within the screen of the smart terminal;

If the visual fixation point falls within the screen of the smart terminal, the brightness of the visual focus area in the screen is controlled to be dimmed according to the visual fixation point.
The computer device according to claim 14, wherein the step of determining whether a relative position of an eye pupil in the face image and a screen of the smart terminal satisfies a preset condition, comprises:

Acquiring position information of the eye pupil;

Analyzing the coordinate value of the eye pupil in a screen coordinate system according to the position information of the eye pupil, wherein the screen coordinate system is a three-dimensional coordinate system with a screen center as an origin;

Determining whether the coordinate value of the eye pupil is within a preset coordinate value range;

If yes, it is determined that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition.
The computer device according to claim 15, wherein before the step of determining whether the coordinate value of the eye pupil is within a preset coordinate value range, comprising:

Acquiring a critical position visible to the screen of the smart terminal;

Labeling the critical position in the screen coordinate system to obtain a critical coordinate value;

Setting the preset coordinate value range according to the critical coordinate value.
The computer device according to claim 14, wherein the step of controlling the brightness of a visual focus area in the screen to be dimmed according to the visual fixation point comprises:

Acquiring a position where the visual fixation point falls on the screen, and forming the visual focus area within a preset range of the position;

Controlling the brightness of the visual focus area to be dimmed.
A computer non-volatile readable storage medium having computer-readable instructions stored thereon, characterized in that when the computer-readable instructions are executed by a processor, an anti-peeping method for an intelligent terminal is implemented, and an anti-peeping method for the intelligent terminal is implemented Methods include:

Capture the face image in front of the screen of the smart terminal;

Determining whether the face image is consistent with a face template preset by the smart terminal;

If the face image is inconsistent with a face template preset by the smart terminal, determining whether a relative position of an eye pupil in the face image and a screen of the smart terminal meets a preset condition;

If the relative position of the eye pupil in the face image and the screen of the smart terminal satisfies a preset condition, determining whether the visual fixation point of the eye pupil falls within the screen of the smart terminal;

If the visual fixation point falls within the screen of the smart terminal, the brightness of the visual focus area in the screen is controlled to be dimmed according to the visual fixation point.
The computer non-volatile readable storage medium according to claim 18, wherein the step of determining whether the relative position of the eye pupil in the face image and the screen of the smart terminal satisfies a preset condition, include:

Acquiring position information of the eye pupil;

Analyzing the coordinate value of the eye pupil in a screen coordinate system according to the position information of the eye pupil, wherein the screen coordinate system is a three-dimensional coordinate system with a screen center as an origin;

Determining whether the coordinate value of the eye pupil is within a preset coordinate value range;

If yes, it is determined that the relative position of the eye pupil in the face image and the screen of the smart terminal meets a preset condition.
The computer non-volatile storage medium according to claim 18, wherein the step of controlling the brightness of a visual focus area in the screen to be dimmed according to the visual fixation point comprises:

Acquiring a position where the visual fixation point falls on the screen, and forming the visual focus area within a preset range of the position;

Controlling the brightness of the visual focus area to be dimmed.