CN113760156A

CN113760156A - Method and device for adjusting terminal screen display

Info

Publication number: CN113760156A
Application number: CN202110171691.1A
Authority: CN
Inventors: 刘登勇
Original assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Wodong Tianjun Information Technology Co Ltd
Current assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Wodong Tianjun Information Technology Co Ltd
Priority date: 2021-02-08
Filing date: 2021-02-08
Publication date: 2021-12-07

Abstract

The invention discloses a method and a device for adjusting terminal screen display, and relates to the technical field of computers. One embodiment of the method comprises: detecting face key points of a user using the terminal in real time; determining the offset angle of the user relative to the terminal according to the face key point; and adjusting the screen display direction of the terminal according to the offset angle. The method and the device solve the problem that the display direction of the terminal screen cannot be automatically adjusted according to the positions of human eyes in the inverted or side-lying scene of the terminal user, so that the display direction of the terminal screen and the directions of the human eyes are always opposite, and improve the use experience of the user.

Description

Method and device for adjusting terminal screen display

Technical Field

The invention relates to the technical field of computers, in particular to a method for adjusting screen display of a terminal.

Background

With the popularization and development of mobile terminal devices, the functions included in the mobile terminal devices are more and more abundant, and accordingly, the adaptability of the mobile terminal devices to mobile applications needs to be further enhanced.

At present, in the prior art, mobile terminals mostly automatically adjust the screen direction of a mobile phone according to a gyroscope. However, in a scene where the user stands upside down or lies on the side, the mobile terminal device cannot adjust the screen display direction according to the change of the human eye direction, and the situation that the screen direction is always opposite to the human eye direction of the user occurs, so that the use experience of the user is greatly influenced.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method and an apparatus for adjusting terminal screen display, which can automatically adjust a screen direction according to a position of eyes of a user, so that the screen direction is adapted to the position of the eyes, thereby improving user experience.

To achieve the above object, according to an aspect of an embodiment of the present invention, there is provided a method for adjusting a screen display of a terminal, including:

detecting face key points of a user using the terminal in real time;

determining the offset angle of the user relative to the terminal according to the face key point;

and adjusting the screen display direction of the terminal according to the offset angle.

Optionally, the determining, according to the face key point, an offset angle of the user with respect to the terminal includes:

determining profile information of the terminal;

and determining the position of the face key point relative to the terminal according to the contour information, and determining the offset angle according to the position.

Optionally, the determining an offset angle of the user with respect to the terminal includes:

establishing a coordinate system according to the terminal point indicated by the contour information of the terminal;

and determining the offset angle according to the coordinates of the face key point coordinates in the coordinate system.

Optionally, the method comprises:

acquiring a facial image of the user in real time by using a camera device of the terminal;

detecting key points of the human face in the facial image according to the facial image and a key point detection model; the face key points comprise any two or more of the following: eyebrow key points, eye key points, mouth key points, nose key points.

Optionally, the method further comprises:

the eyebrow key points include any one or more of: center of eyebrow, tail and head; and/or;

the eye key points include any one or more of: center of the eye, inner corner of the eye and outer corner of the eye.

Optionally, when the face key points include the eyebrow key points and the eye key points, the determining an offset angle of the user with respect to the terminal includes:

determining an eyebrow center indicated by the eyebrow key points and an eye center indicated by the eye key points;

determining the position of a connecting line of the eyebrow center and the eye center relative to a coordinate axis in the coordinate system;

calculating the offset angle from the position.

Optionally, the terminal should have at least two adjustable angles; the adjusting the screen display direction of the terminal according to the offset angle includes:

determining a difference between the offset angle and the at least two adjustable angles, respectively;

determining a target adjustable angle corresponding to the minimum difference value from the two adjustable angles;

and adjusting the screen display direction of the terminal according to the target adjustable angle.

Optionally, the method further comprises:

the at least two adjustable angles include 0 °, 90 °, 180 °, and 270 °.

According to a second aspect of the embodiments of the present invention, there is provided a test apparatus for an application, including: the device comprises a detection module, a determination module and an adjustment module; wherein,

the detection module is used for detecting the face key points of the user using the terminal in real time;

the determining module is used for determining the offset angle of the user relative to the terminal according to the face key point;

and the adjusting module is used for adjusting the screen display direction of the terminal according to the offset angle.

Alternatively,

the determining module is used for establishing a coordinate system according to the terminal point of the terminal;

Alternatively,

the adjusting module is used for respectively determining the difference between the offset angle and the at least two adjustable angles;

According to a third aspect of embodiments of the present invention, there is provided a server, including:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement a method as in any one of the methods for testing an application as provided in the first aspect above.

According to a fourth aspect of embodiments of the present invention, there is provided a computer readable medium, on which a computer program is stored, which when executed by a processor implements the method of any one of the methods of testing an application as provided in the first aspect above.

One embodiment of the above invention has the following advantages or benefits: the method comprises the steps of collecting user images in real time through a camera device of the terminal equipment, identifying face key points in the face images, determining the offset angle of the face direction according to the face key points, and adjusting the direction of a display screen of the terminal according to the offset angle. Therefore, the direction of the terminal display screen is automatically adjusted according to the position of human eyes, the problem that the direction of the terminal display screen is inconsistent with the direction of the human eyes when a user lies on the side or stands upside down is solved, the use experience of the user can be improved, and the use convenience is brought to the user.

Further effects of the above-mentioned non-conventional alternatives will be described below in connection with the embodiments.

Drawings

The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:

fig. 1 is a schematic diagram of a main flow of a method of adjusting a terminal screen display according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of locations of keypoints of the keypoint detection model according to the embodiment of the present invention;

FIG. 3 is a schematic diagram of a rectangular plane coordinate system established according to a terminal device according to an embodiment of the present invention;

FIG. 4 is a diagram illustrating key points directly outputting the center of the eyebrow and the center of the eye in the embodiment of the present invention;

FIG. 5 is a schematic diagram illustrating exemplary key points for indirectly outputting the eyebrow, eyebrow tail, inner canthus and outer canthus in accordance with an embodiment of the present invention;

FIG. 6 is a schematic diagram of an embodiment of the present invention in which a left mouth corner and a right mouth corner are used as key points of a human face;

FIG. 7 is a schematic diagram illustrating an embodiment of determining a face direction vector and further determining a face offset angle according to the eyebrow center and the eye center;

FIG. 8 is a schematic diagram of a face offset angle of 0 in an embodiment of the present invention;

FIG. 9 is a schematic diagram of a face offset angle of 90 in an embodiment of the present invention;

FIG. 10 is a schematic diagram of a face offset angle of 180 in an embodiment of the present invention;

FIG. 11 is a schematic diagram of a face offset angle of 270 according to an embodiment of the present invention;

FIG. 12 is a schematic diagram of an embodiment of the present invention in which the face offset angle is 40 °;

FIG. 13 is a schematic diagram of a face offset angle of 120 in an embodiment of the present invention;

FIG. 14 is a diagram illustrating a face offset angle of 160 in an embodiment of the present invention;

FIG. 15 is a schematic diagram of a face offset angle of 260 in an embodiment of the present invention;

fig. 16 is a schematic diagram of main blocks of an apparatus for adjusting a method of displaying a screen of a terminal according to an embodiment of the present invention;

FIG. 17 is an exemplary system architecture diagram in which embodiments of the present invention may be employed;

fig. 18 is a schematic structural diagram of a computer system suitable for implementing a terminal device or a server according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which various details of embodiments of the invention are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

As shown in fig. 1, a method for adjusting a terminal screen display according to an embodiment of the present invention may include the following steps S101 to S103:

step S101: and detecting the face key points of the user using the terminal in real time.

Step S102: and determining the offset angle of the user relative to the terminal according to the face key point.

In the embodiment of the invention, the face key points of the user can be obtained in the following ways: acquiring a facial image of the user in real time by using a camera device of the terminal; detecting key points of the human face in the facial image according to the facial image and a key point detection model; the face key points comprise any two or more of the following: eyebrow key points, eye key points, mouth key points, nose key points.

As shown in fig. 2, the eyebrow key points include any one or more of the following: center of eyebrow, brow head or brow tail; in addition, eye keypoints include one or more of: center of the eye, inner corner of the eye or outer corner of the eye.

It is understood that, in order to facilitate the calculation of the offset angle of the user with respect to the terminal, in the embodiment of the present invention, the eyebrow key points and the eye key points correspond to each other. For example, when an eyebrow keypoint includes the center of the eyebrow, an eye keypoint also includes the center of the eye. When the eyebrow keypoints include the eyebrow tip and the eyebrow tail of the left eye, the eye keypoints also include the inner canthus and the outer canthus of the left eye, and correspondingly, when the eyebrow keypoints include the eyebrow tip and the eyebrow tail of the right eye, the eye keypoints also include the inner canthus and the outer canthus of the right eye. Therefore, when the offset angle of the user relative to the terminal is calculated, the offset angle of the user relative to the terminal can be conveniently and quickly calculated according to the position/direction of the direction vector of the eyebrow center and the eye center or the position/direction of the direction vector of the left or right eyebrow in the coordinate system corresponding to the terminal.

In the embodiment of the present invention, the offset angle of the user with respect to the terminal may be determined by: determining profile information of the terminal; and determining the position of the face key point relative to the terminal according to the contour information, and determining the offset angle according to the position.

The contour information of the terminal may include information such as an edge line of the terminal and/or an end point of the terminal. For example, taking the terminal shown in fig. 3 as an example, if the edge line of the terminal is a rectangular edge line, the position of the face key point relative to the terminal can be determined according to factors such as the distance and the included angle between the face key point and the edge line, and the offset angle of the user relative to the terminal can be further determined according to the position.

In addition, a coordinate system can also be established according to the terminal points indicated by the terminal outline information; and determining the offset angle according to the coordinates of the face key point coordinates in the coordinate system.

Specifically, the rectangular coordinate system may be established as shown in fig. 3, that is, the lower left corner of the terminal is taken as the origin of coordinates, the transverse direction of the terminal is taken as the transverse axis, and the longitudinal direction of the terminal is taken as the longitudinal axis. And (3) setting the coordinate of the upper left corner of the terminal as (0, 1) and the coordinate of the lower right corner of the terminal as (1, 0). Firstly, determining the face key points according to the key point detection model, determining face key point coordinates, determining face direction vectors according to the face key point coordinates, and determining the offset angle according to the face direction vectors.

In the embodiment of the present invention, the face key points may be determined at least in the following four ways:

the first method is as follows: and the key point test model directly outputs the eyebrow center and the eye center, and then the eyebrow center and the eye center output by the key point test model are directly used as the key points of the human face.

For example, at a certain time, the face keypoints determined by the keypoint model are as shown in fig. 4, the eyebrow center coordinates are (0.3, 0.65), and the eye center coordinates are (0.3, 0.6). This mode directly outputs the eyebrow center and the eye center.

In a second mode, the key point test model outputs the eyebrow, the tail, the inner canthus and the outer canthus. And determining the coordinates of the eyebrow center and the eye center according to the coordinates of the eyebrow head, the eyebrow tail, the inner canthus and the outer canthus, and then taking the determined coordinates of the eyebrow center and the eye center as key points of the human face.

Taking an image acquired by a camera of a certain terminal in real time as an example, the key points of the human face are as shown in fig. 5, the coordinates of the eyebrow are (0.35, 0.65), the coordinates of the eyebrow tail are (0.25, 0.65), the coordinates of the inner canthus are (0.35, 0.6), and the coordinates of the outer canthus are (0.25, 0.6). Since the center of the eyebrow is the midpoint of the line connecting the brow head and the brow tail, the coordinates of the center of the eyebrow are obtained as (0.3, 0.65). Since the eye center is the midpoint of the inner corner of the eye and the outer corner of the eye, the coordinates of the eye center are obtained as (0.3, 0.6).

The third method comprises the following steps: and taking the mouth as the key point of the human face. Wherein the mouth includes a left mouth corner and a right mouth corner. And the key point testing model outputs the coordinates of the left mouth corner and the right mouth corner to obtain the key points of the human face.

Taking an image collected by a camera device of a certain terminal as an example, a face key point of the terminal is shown in fig. 6, the left mouth angle coordinate is (0.3, 0.4), and the right mouth angle coordinate is (0.6, 0.4). Namely, the coordinates of the key points output by the face key point model are (0.3, 0.4), (0.6, 0.4).

The method is as follows: and taking the coordinates of the tip of the nose and the center of the mouth as key points of the face. Wherein, the center of the mouth can be calculated by the coordinates of the left mouth angle and the right mouth angle. Of course, the key point test model may also directly output the coordinates of the nose tip and the center of the mouth, and therefore, the face key points may also be directly obtained according to the coordinates of the nose tip and the center of the mouth output by the key point test model.

It is understood that the above four ways are only examples of determining the face keypoints according to the output of the keypoint detection model in the embodiment of the present invention. In the embodiment of the present invention, the face key points may also be determined by other combinations of the above eyebrow key points, eye key points, mouth key points, and nose key points, for example, taking the center of the mouth and the center of the eyes as the face key points, or taking the tip of the nose and the center of the eyes as the face key points, and the like. That is, the above four modes are only examples that can be realized, and do not limit the modes in which the present invention can be realized.

The above key point detection model is characterized in that the key point model is trained to achieve the purpose of giving a face image and positioning the positions of the key points of the face, wherein the positions comprise the eyebrow key points, the eye key points, the mouth key points and the nose key points. In a specific way, a group of face images marked with a plurality of face key points is required as a training data set, and different expressions and postures of a plurality of people are included. The face key points can be marked on the eyebrow head and the eyebrow tail of the eyebrow; the inner corner of the eye, the outer corner of the eye; the left mouth angle, the right mouth angle of the mouth; the position of the tip and peak of the nose. Inputting the training data set marked with the key points of the human face into a neural network model to train the neural network model, and taking the trained neural network model as a key point detection model. Then, the face key points can be determined according to the key point detection model, and then the coordinates in the coordinate system can be determined according to the face key points.

The face detection model can accurately detect the face key points, including the eyebrow key points, the eye key points, the nose key points and the mouth key points. Therefore, the terminal can accurately judge the face direction, and then the screen display direction of the terminal is correspondingly adjusted according to the face direction, so that the user experience is better improved.

In an embodiment of the present invention, when the face key points include the eyebrow key points and the eye key points, the determining an offset angle of the user with respect to the terminal includes: determining an eyebrow center indicated by the eyebrow key points and an eye center indicated by the eye key points; determining the position of a connecting line of the eyebrow center and the eye center relative to a coordinate axis in the coordinate system; calculating the offset angle from the position.

For example, the offset angle may be calculated from the angle between the line connecting the center of the eyebrow and the center of the eye and the coordinate axis. As shown in fig. 7, the offset angle can be calculated from the angle between the line connecting the center of the eyebrow and the center of the eye and the 18-axis. For example, using fig. 7 as an example, the coordinates of the face key points output from the key point detection model are the eyebrow center (0.2, 0.6) and the eye center (0.3, 0.55), respectively. The face direction vector is obtained as (-0.1, 0.05), and the offset angle of the face direction with respect to the terminal device is obtained as 296.57 °.

In one embodiment of the present invention, the offset angle is determined in the following manner. And when the abscissa or the ordinate of the key point of the eyebrow center and the eye center determined according to the human face key point root is consistent, calculating the offset angle according to the abscissa and the ordinate.

Specifically, if the eyebrow center is coincident with the eye center abscissa and the eyebrow center ordinate is greater than the eye center ordinate, it can be found that the offset angle at this time is 0 °; on the contrary, if the eyebrow center ordinate is smaller than the eye center ordinate, it can be found that the offset angle at this time is 180 °.

Specifically, if the eyebrow center is coincident with the eye center ordinate, and the eyebrow center abscissa is larger than the eye center abscissa, it can be found that the offset angle at this time is 90 °; on the contrary, if the eyebrow center abscissa is smaller than the eye center abscissa, it can be found that the offset angle at this time is 270 °.

Still taking the above fig. 4 as an example, the determined face key points are shown in the figure, the eyebrow center coordinates are (0.3, 0.65), and the eye center coordinates are (0.3, 0.6). Since the eyebrow center of the face key point is the same as the abscissa of the eye center, and the ordinate of the eyebrow center is greater than the ordinate of the eye center, it can be found that the offset angle is 0 °.

Step S103: and adjusting the screen display direction of the terminal according to the offset angle.

And after the offset angle is determined, the screen display direction of the terminal can be adjusted to be matched with the use angle of the user. For example, when the offset angle is 80 °, the screen display direction of the terminal is adjusted to be offset by 80 ° relative to the current screen display direction, so that the screen display direction of the terminal is consistent with the orientation of the user, thereby improving the user experience.

In addition, in an embodiment of the present invention, the terminal may also be provided with a fixed adjustment angle, for example, the screen adjustable angle of the terminal includes 0 °, 90 °, 180 °, and 270 °, when the offset angle is the same as the adjustable angle of the terminal, the screen direction is adjusted according to the offset angle, and when the offset angle is different from the adjustable angle of the terminal, the direction of the terminal screen may be adjusted in the following manner: determining a difference between the offset angle and the at least two adjustable angles, respectively; determining a target adjustable angle corresponding to the minimum difference value from the two adjustable angles; and adjusting the screen display direction of the terminal according to the target adjustable angle.

Still taking the above-mentioned offset angle as 80 ° as an example, if the absolute values of the differences between the offset angle and the four adjustable angles of the terminal, 0 °, 90 °, 180 °, and 270 °, are respectively 80 °, 10 °, 100 °, and 190 °, the target adjustable angle corresponding to the minimum difference is 90 °, and then the display direction of the terminal may be adjusted according to the determined target adjustable angle, that is, the display direction of the terminal is adjusted by 90 ° relative to the current display direction.

When the terminal is provided with fixed adjustment angles of 0 °, 90 °, 180 °, and 270 °, if the screen display direction is adjusted in the above manner, the screen display direction may be adjusted with reference to table 1 below:

TABLE 1

By angle of deflection (°)	0-44	45-134	135-224	225-359
					Screen display direction (°)	0	90	180	270

Specifically, in an embodiment of the present invention, the detected face key points and their coordinates are shown in fig. 8, where the face key point coordinates are the eyebrow center (0.3, 0.65) and the eye center (0.3, 0.6). From this, the face direction vector is (0, 0.05), and the offset angle is calculated to be 0 ° according to the face direction vector. And adjusting the display direction of the terminal screen to be 0 degree according to the offset angle because the offset angle is consistent with the display direction of the terminal screen.

Specifically, in an embodiment of the present invention, the detected face key points and their coordinates are shown in fig. 9, where the face key point coordinates are the eyebrow center (0.7, 0.6) and the glasses center (0.6 ). Therefore, the direction vector of the face key point is (0.1, 0), and the offset angle is calculated to be 90 degrees according to the face direction vector. And adjusting the display direction of the terminal screen to be 90 degrees according to the offset angle because the offset angle is consistent with the display direction of the terminal screen.

Specifically, in an embodiment of the present invention, the detected face key points and their coordinates are shown in fig. 10, where the face key point coordinates are the eyebrow center (0.4 ) and the eye center (0.4, 0.45). Therefore, the direction vector of the face key point is (0, -0.05), and the offset angle is calculated to be 180 degrees according to the face direction vector. And adjusting the display direction of the terminal screen to be 180 degrees according to the offset angle because the offset angle is consistent with the display direction of the terminal screen.

Specifically, in an embodiment of the present invention, the detected face key points and their coordinates are shown in fig. 11, where the face key point coordinates are the eyebrow center (0.35,0.5) and the glasses center (0.4, 0.5). Therefore, the direction vector of the face key point is (-0.05,0), and the offset angle is 270 degrees according to the face direction vector. And adjusting the display direction of the terminal screen to be 270 degrees according to the offset angle because the offset angle is consistent with the display direction of the terminal screen.

Specifically, in one embodiment of the present invention, as shown in fig. 12, the detected offset angle is 40 °. Because the offset angle is not consistent with the screen display direction of the terminal, according to the adjustment mode, the screen display direction of the terminal can be adjusted to be 0 degree according to the offset angle.

Specifically, in one embodiment of the present invention, as shown in fig. 13, the detected offset angle is 120 °. And adjusting the screen display direction of the terminal to be 90 degrees according to the offset angle according to the adjustment mode because the offset angle is not consistent with the screen display direction of the terminal.

Specifically, in one embodiment of the present invention, as shown in fig. 14, the detected offset angle is 160 °. And adjusting the screen display direction of the terminal to be 180 degrees according to the offset angle according to the adjustment mode because the offset angle is not consistent with the screen display direction of the terminal.

Specifically, in one embodiment of the present invention, as shown in fig. 15, the detected offset angle is 260 °. And adjusting the screen display direction of the terminal to be 270 degrees according to the offset angle according to the adjustment mode because the offset angle is not consistent with the screen display direction of the terminal.

As shown in fig. 16, an embodiment of the present invention provides an applied test apparatus 1600, including: a detection module 1601, a determination module 1602, and an adjustment module 1603; wherein,

the detection module 1601 is used for detecting the face key points of the user using the terminal in real time;

the determining module 1602, configured to determine, according to the face key point, an offset angle of the user with respect to the terminal;

the adjusting module 1603 is configured to adjust a screen display direction of the terminal according to the offset angle.

In an embodiment of the present invention, the determining module 1602 is configured to determine profile information of the terminal; and determining the position of the face key point relative to the terminal according to the contour information, and determining the offset angle according to the position.

In an embodiment of the present invention, the determining module 1602 is configured to establish a coordinate system according to an endpoint of the terminal indicated by the profile information of the terminal; and determining the offset angle according to the coordinates of the face key point coordinates in the coordinate system.

In an embodiment of the present invention, the detecting module 1601 is configured to capture a facial image of the user in real time by using a camera of the terminal; detecting key points of the human face in the facial image according to the facial image and a key point detection model; the face key points comprise any two or more of the following: eyebrow key points, eye key points, mouth key points, nose key points; the eyebrow key points include any one or more of: center of eyebrow, tail and head; and/or; the eye key points include any one or more of: center of the eye, inner corner of the eye and outer corner of the eye.

In an embodiment of the present invention, the determining module 1602 is configured to determine an eyebrow center indicated by the eyebrow key points and an eye center indicated by the eye key points; determining the position of a connecting line of the eyebrow center and the eye center relative to a coordinate axis in the coordinate system; calculating the offset angle from the position.

In an embodiment of the present invention, the adjusting module 1603 is configured to determine a difference between the offset angle and the at least two adjustable angles, respectively; determining a target adjustable angle corresponding to the minimum difference value from the two adjustable angles; and adjusting the screen display direction of the terminal according to the target adjustable angle.

In an embodiment of the present invention, the adjusting module 1603 is configured to determine a difference between the offset angle and the at least two adjustable angles, respectively; determining a target adjustable angle corresponding to the minimum difference value from the two adjustable angles; and adjusting the screen display direction of the terminal according to the target adjustable angle. The at least two adjustable angles include 0 °, 90 °, 180 °, and 270 °.

An embodiment of the present invention further provides a server, including: one or more processors; a storage device, configured to store one or more programs, which when executed by the one or more processors, cause the one or more processors to implement a method for testing an application as provided in any of the embodiments above.

The embodiment of the invention also provides a computer readable medium, on which a computer program is stored, and when the program is executed by a processor, the computer program realizes the application testing method provided by any one of the above embodiments.

Fig. 17 shows an exemplary system architecture 1700 to which the terminal screen display direction adjustment method or the terminal screen display direction adjustment apparatus according to the embodiment of the present invention can be applied.

As shown in fig. 17, the system architecture 1700 may include

terminal devices

1701, 1702, 1703, a network 1704, and a server 1705. The network 1704 serves as a medium for providing communication links between

terminal devices

1701, 1702, 1703 and the server 1705. The network 1704 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

A user may use the

terminal devices

1701, 1702, 1703 to interact with the server 1705 through the network 1704 to receive or send messages or the like. The

terminal devices

1701, 1702, 1703 may have installed thereon various communication client applications, such as shopping-like applications, web browser applications, search-like applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only).

The

terminal devices

1701, 1702, 1703 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.

The server 1705 may be a server that provides various services, such as a backend management server (for example only) that supports shopping websites browsed by users using the

terminal devices

1701, 1702, 1703. The backend management server may analyze and perform other processing on the received data such as the product information query request, and feed back a processing result (for example, target push information, product information — just an example) to the terminal device.

It should be noted that the method for adjusting the display direction of the terminal screen provided by the embodiment of the present invention is generally executed by the

terminal devices

1701, 1702 and 1703, and accordingly, the device for adjusting the display direction of the terminal screen is generally disposed in the

terminal devices

1701, 1702 and 1703.

It should be understood that the number of terminal devices, networks, and servers in fig. 17 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

Referring now to FIG. 18, a block diagram of a computer system 1800 suitable for use with a terminal device implementing an embodiment of the invention is shown. The terminal device shown in fig. 18 is only an example, and should not bring any limitation to the functions and the range of use of the embodiment of the present invention.

As shown in fig. 18, the computer system 1800 includes a Central Processing Unit (CPU)1801, which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)1802 or a program loaded from a storage portion 1808 into a Random Access Memory (RAM) 1803. In the RAM 1803, various programs and data necessary for the operation of the system 1800 are also stored. The CPU 1801, ROM 1802, and RAM 1803 are connected to each other via a bus 1804. An input/output (I/O) interface 1805 is also connected to bus 1804.

The following components are connected to the I/O interface 1805: an input portion 1806 including a keyboard, a mouse, and the like; an output portion 1807 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 1808 including a hard disk and the like; and a communication section 1809 including a network interface card such as a LAN card, a modem, or the like. The communication section 1809 performs communication processing via a network such as the internet. A driver 1810 is also connected to the I/O interface 1805 as needed. A removable medium 1811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 1810 as necessary, so that a computer program read out therefrom is mounted in the storage portion 1808 as necessary.

In particular, according to the embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via the communication portion 1809, and/or installed from the removable media 1811. The computer program performs the above-described functions defined in the system of the present invention when executed by the Central Processing Unit (CPU) 1801.

It should be noted that the computer readable medium shown in the present invention can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules described in the embodiments of the present invention may be implemented by software or hardware. The described modules may also be provided in a processor, which may be described as: a processor includes a sending module, an obtaining module, a determining module, and a first processing module. The names of these modules do not form a limitation on the modules themselves in some cases, and for example, the sending module may also be described as a "module sending a picture acquisition request to a connected server".

As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be separate and not incorporated into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to comprise: detecting face key points of a user using the terminal in real time; determining the offset angle of the user relative to the terminal according to the face key point; and adjusting the screen display direction of the terminal according to the offset angle.

According to the technical scheme of the embodiment of the invention, the face key points of the user can be detected in real time, the face direction can be determined according to the face key points, and the direction of the terminal display screen can be correspondingly adjusted. Under the scene that the user stands upside down or lies on one side, the watch orientation of the user can be actively adapted to, the use of the user is greatly facilitated, and the use experience of the user is improved.

The above-described embodiments should not be construed as limiting the scope of the invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions can occur, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for adjusting terminal screen display is characterized by comprising the following steps:

detecting face key points of a user using the terminal in real time;

2. The method according to claim 1, wherein the determining an offset angle of the user with respect to the terminal according to the face key point comprises:

determining profile information of the terminal;

3. The method of claim 2, wherein the determining the offset angle of the user with respect to the terminal comprises:

4. The method of claim 1,

5. The method of claim 4,

6. The method of claim 4 or 5, wherein when the face keypoints comprise the eyebrow keypoints and the eye keypoints, the determining an offset angle of the user with respect to the terminal comprises:

calculating the offset angle from the position.

7. The method of claim 1, wherein the terminal has at least two adjustable angles; the adjusting the screen display direction of the terminal according to the offset angle includes:

8. The method of claim 7, wherein the at least two adjustable angles comprise 0 °, 90 °, 180 °, and 270 °.

9. An apparatus for adjusting a display screen of a terminal, comprising: the device comprises a detection module, a determination module and an adjustment module; wherein,

10. An electronic device for adjusting a display screen of a terminal, comprising:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-8.

11. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 1-8.