WO2023061325A1

WO2023061325A1 - Picture display method and apparatus, terminal device, and storage medium

Info

Publication number: WO2023061325A1
Application number: PCT/CN2022/124352
Authority: WO
Inventors: 任前山
Original assignee: 展讯通信（深圳）有限公司
Priority date: 2021-10-11
Filing date: 2022-10-10
Publication date: 2023-04-20
Also published as: CN113867535B; CN113867535A

Abstract

Embodiments of the present invention relate to the technical field of intelligent terminals, and provide a picture display method and apparatus, a terminal device, and a storage medium. In the rotation process of an electronic terminal device, a dynamic screen display picture is obtained, and a rotation angle of the electronic terminal device is compensated by means of the dynamic screen display picture to ensure that an angle of the sight of a user relative to the screen display picture is always an optimal angle of screen picture watching. The method comprises: each time a terminal display panel rotates by a preset angle relative to a preset reference plane, obtaining a screen rendering picture corresponding, at a current moment, to the terminal display panel that correspondingly rotates by the preset angle; and projecting the obtained screen rendering picture to the preset reference plane to obtain a screen display picture on the preset reference plane.

Description

Screen display method, device, terminal equipment and storage medium

This application claims the priority of the Chinese patent application with the application number 202111182044.7 and the application title "screen display method, device, terminal equipment and storage medium" submitted to the China Patent Office on October 11, 2021, the entire contents of which are incorporated by reference in this application.

technical field

The present application relates to the technical field of smart terminals, and in particular to a screen display method, device terminal equipment, and storage media.

Background technique

At present, most electronic terminal devices have display panels, through which users can watch videos, consult webpages, and edit documents, which provides convenience for users' work and life.

In some specific occasions, the electronic terminal device will rotate due to external force or the use of the operator, the electronic terminal device will rotate, the display panel will deviate from the user's original line of sight, and the angle of the user's viewing screen will also deviate accordingly. The electronic terminal device rotates to From a certain angle, the user cannot clearly see the complete picture displayed on the display panel based on the original line of sight, resulting in a poor user experience.

Contents of the invention

Embodiments of the present invention provide a screen display method, device, terminal device, and storage medium. During the rotation of the electronic terminal device, a dynamic screen display image is obtained, and the dynamic screen display image is used to compensate the rotation angle of the electronic terminal device. Ensure that the angle between the user's line of sight and the screen display is always at the best angle for viewing the screen.

In the first aspect, an embodiment of the present invention provides a screen display method, which is applied to an electronic device terminal. The method includes: comparing the terminal display panel with a preset reference plane, each time the preset angle is rotated, the corresponding preset angle of rotation is obtained. The screen rendering picture corresponding to the terminal display panel at the current moment; and projecting the obtained screen rendering picture onto the preset reference plane to obtain the screen display picture on the preset reference plane.

In the above picture display method, during the rotation process of the electronic terminal device, the obtained screen rendering picture is not directly displayed on the terminal display panel, but the obtained screen rendering picture is projected onto the preset reference plane, and then projected onto the preset reference plane. The flat screen display screen is displayed on the terminal display panel. During the rotation of the electronic terminal device, no matter what changes in the angle between the terminal display panel and the user's line of sight, the picture displayed on the terminal display panel is in the best viewing position of the user's line of sight. .

In one possible implementation manner, the projecting the obtained screen rendering picture to the preset reference plane includes:

When the terminal display panel is compared with the preset reference plane, each time the preset angle is rotated, the deviation angle of the terminal display panel corresponding to the preset rotation angle at the current moment compared with the preset reference plane is obtained;

Projecting the obtained screen rendering picture to the preset reference plane according to the deviation angle.

In one possible implementation manner, the projecting the obtained screen rendering picture to the preset reference plane according to the deviation angle includes:

Obtaining the deviation direction of the deviation angle compared to the preset reference plane;

Projecting the obtained screen rendering picture onto the preset reference plane along a target direction opposite to the deviation direction.

In one of the possible implementation manners, the obtaining the screen rendering picture corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment includes:

Obtaining at least one screen rendering canvas corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment; wherein, different screen rendering canvases are rendered based on different display angles; the at least one screen rendering canvas is used to form the screen rendering screen;

Projecting the obtained screen rendering picture onto the preset reference plane to obtain a screen display picture on the preset reference plane, including:

Input the display angle and the deviation angle based on which each screen rendering canvas is rendered into the preset compensation angle calculation model to obtain the projection position of each screen rendering canvas; wherein, the projection position of at least one of the screen rendering canvases is the same as the The positions of the above-mentioned preset datum planes coincide;

Project each screen rendering canvas to their corresponding projection positions;

Based on the screen rendering canvases projected to the preset reference plane, the at least one screen rendering canvas projected to respective corresponding projection positions are superimposed to obtain a screen display image on the preset reference plane.

In one of the possible implementations, the method further includes:

Generate a display window matching the size of the screen display on the preset reference plane according to the deviation angle;

The projecting the obtained screen rendering picture to the preset reference plane includes:

Projecting the obtained screen rendering picture into the display window of the preset reference plane.

In one of the possible implementation manners, the obtaining the deviation angle of the terminal display panel corresponding to the preset rotation angle compared with the preset reference plane at the current moment includes:

By using the built-in gyro sensor, the deviation angle of the terminal display panel corresponding to the rotation of the preset angle compared with the preset reference plane at the current moment is obtained.

In one of the possible implementation manners, the obtaining the deviation direction of the deviation angle compared to the preset reference plane;

A deviation direction of the deviation angle compared to the preset reference plane is obtained through a built-in acceleration sensor.

In the second aspect, an embodiment of the present invention provides a screen display device, which is set in an electronic device terminal, and the device includes:

The rotation module is used to obtain the screen rendering picture corresponding to the terminal display panel corresponding to the rotation preset angle at the current moment when the terminal display panel is rotated by a preset angle compared with the preset reference plane;

The screen display image obtaining module is configured to project the obtained screen rendering image onto the preset reference plane to obtain a screen display image on the preset reference plane.

In one of the possible implementation manners, the screen display image acquisition module includes:

The deviation angle obtaining sub-module is used to obtain the corresponding rotation preset angle of the terminal display panel at the current moment compared with the preset reference plane every time the terminal display panel rotates a preset angle. The deviation angle of the preset datum plane;

The first projecting sub-module is configured to project the obtained screen rendering picture to the preset reference plane according to the deviation angle.

In one possible implementation manner, the first projecting submodule includes:

a deviation direction obtaining subunit, configured to obtain a deviation direction of the deviation angle compared with the preset reference plane;

The target direction projecting subunit is configured to project the obtained screen rendering picture onto the preset reference plane along a target direction opposite to the deviation direction.

In one of the possible implementation manners, the rotating module includes:

The rendering sub-module is used to obtain at least one screen rendering canvas corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment; wherein, the display angles on which different screen rendering canvases are rendered are different; the at least one screen rendering canvas for forming the screen rendering picture;

The screen display frame acquisition module includes:

The input sub-module is used to input the display angle based on rendering each screen rendering canvas and the deviation angle into the preset compensation angle calculation model to obtain the projection position of each screen rendering canvas; wherein at least one of the screen rendering The projection position of the canvas coincides with the position of the preset reference plane;

The second projecting sub-module is used to project each screen rendering canvas to its corresponding projecting position;

The superposition sub-module is configured to superimpose the at least one screen rendering canvas projected to their corresponding projection positions based on the screen rendering canvases projected on the preset reference plane, to obtain a screen display picture on the preset reference plane.

In one of the possible implementation manners, the device further includes:

A generating module, configured to generate a display window matching the size of the screen display on the preset reference plane according to the deviation angle;

The screen display frame acquisition module includes:

The third projecting sub-module is configured to project the obtained screen rendering picture into the display window of the preset reference plane.

In one possible implementation manner, the submodule for obtaining the deviation angle includes:

The deviation angle acquisition subunit is configured to obtain, through a built-in gyro sensor, a deviation angle of the terminal display panel that is rotated corresponding to the preset angle relative to the preset reference plane at the current moment.

In one possible implementation manner, the deviation direction obtaining subunit is specifically configured to obtain a deviation direction of the deviation angle compared with the preset reference plane through a built-in acceleration sensor.

In a third aspect, an embodiment of the present invention provides a terminal device, including: at least one processor; and at least one memory communicated with the processor, wherein: the memory stores a program executable by the processor Instructions, the processor invokes the program instructions to execute the method provided in the first aspect.

In a fourth aspect, an embodiment of the present invention provides a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions cause the computer to execute the method provided in the first aspect.

It should be understood that the second to fourth aspects of the embodiments of the present invention are consistent with the technical solutions of the first aspect of the embodiments of the present invention, and the beneficial effects obtained by each aspect and the corresponding feasible implementation manners are similar, so details are not repeated here.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the accompanying drawings that need to be used in the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. Those of ordinary skill in the art can also obtain other drawings based on these drawings without any creative effort.

Fig. 1 is a schematic diagram of rotation of a terminal display panel of an electronic terminal device;

FIG. 2 is a flow chart of the steps of the screen display method proposed by the embodiment of the present invention;

Fig. 3 is a schematic diagram of projecting a screen rendering picture to a preset reference plane according to an example of the present invention;

Fig. 4 is a schematic diagram of projecting a screen rendering picture formed by at least one screen rendering canvas to a preset reference plane according to an example of the present invention;

Fig. 5 is a flow chart of an exemplary electronic terminal device execution screen display method according to the present invention;

Fig. 6 is an effect diagram of a terminal display panel display screen display screen after being processed by a screen display method proposed by an example of the present invention;

7 is a functional block diagram of a screen display device proposed by an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of an electronic terminal device provided by an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a terminal device provided by an embodiment of this specification.

Detailed ways

In order to better understand the technical solutions of the present application, the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.

It should be clear that the described embodiments are only some of the embodiments of the present application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

Terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of this application and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise.

Figure 1 is a schematic diagram of the rotation of the terminal display panel of the electronic terminal device. As shown in Figure 1, before the electronic terminal device rotates, the angle between the terminal display panel 11 and the user's line of sight is 90°, and the user is at the best viewing angle. The rotation deviates from its original plane, the angle between the rotated terminal display panel 12 and the user's line of sight is 120°, and the rotated terminal display panel 12 deviates from the best viewing angle for the user. The user has to adjust his line of sight in order to watch the complete picture displayed by the rotated terminal display panel 12, resulting in poor user experience.

In order to solve the problem that the electronic terminal equipment rotates, the terminal display panel deviates from the user's original line of sight, and the terminal display panel cannot display a picture that matches the user's line of sight, an embodiment of the present invention proposes a picture display method for electronic terminal equipment, electronic terminal equipment It may be an electronic device carrying a display panel such as a tablet, a computer, or a mobile phone.

Fig. 2 is a flow chart of the steps of the screen display method proposed by the embodiment of the present invention. As shown in Fig. 2, the steps include:

Step S21: Obtain a screen rendering picture corresponding to the current moment of the terminal display panel corresponding to the preset rotation angle every time the terminal display panel is rotated by a preset angle compared with the preset reference plane.

The preset reference plane is a preset horizontal plane or vertical plane in the electronic terminal equipment. The preset angle can be any value. According to the accuracy setting of the display screen of the terminal display panel, the smaller the preset angle is, the higher the frequency that the electronic terminal device obtains the screen rendering image and projects the screen rendering image to the preset reference plane , the better the screen display effect presented by the terminal display panel is.

The screen rendering picture is a picture output by the electronic terminal device according to the current picture data, and the GPU module of the electronic terminal device can be used to render the screen rendering picture according to the current picture data. The screen display picture is a picture displayed on the display panel of the terminal.

Step S22: Projecting the obtained screen rendering image onto the preset reference plane to obtain a screen display image on the preset reference plane.

In an example of the present invention, the preset angle is 1°. Before the electronic terminal device rotates, the terminal display panel coincides with the preset reference plane, t1 the electronic terminal device rotates 1°, and the angle between the terminal display panel and the preset reference plane is is 1°, obtain the screen rendering picture A1 output according to the image data at time t1, and project the screen rendering picture A1 onto the preset reference plane; at t2, the electronic terminal equipment rotates 1°, and the angle between the terminal display panel and the preset reference plane is 2° , obtain the screen rendering picture A2 output according to the image data at time t2, and project the screen rendering picture A2 onto the preset reference plane; at t3, the electronic terminal equipment rotates 1°, the angle between the terminal display panel and the preset reference plane is 3°, and t3 is obtained According to the screen rendering picture A3 output by the image data at all times, the screen rendering picture A3 is projected to the preset reference plane; when the terminal display panel rotates with itself, the electronic terminal equipment will turn the current screen rendering picture A3 every time it rotates 1° Projected to the preset reference plane, and the angle between the preset reference plane and the user's line of sight remains unchanged, then during the rotation process, no matter how the terminal display panel rotates, it is projected to the preset reference plane so that the screen displayed on the preset reference plane The angle between the screen and the user's line of sight is always the same.

During the rotation process of the electronic terminal device in the embodiment of the present invention, instead of directly displaying the obtained screen rendering picture on the terminal display panel, it projects the obtained screen rendering picture onto a preset reference plane before displaying the picture on the terminal display panel, and then The screen display screen projected onto the preset reference plane is displayed on the terminal display panel. During the rotation of the electronic terminal device, no matter what changes in the angle between the terminal display panel and the user's line of sight, the screen displayed on the terminal display panel is always at the user's Optimal viewing position in line of sight.

Another embodiment of the present invention proposes an implementation method for projecting a screen rendering image onto a preset reference plane, the steps of which include:

Step S221: When the terminal display panel is compared with the preset reference plane, each time the preset angle is rotated, obtain the corresponding rotation preset angle of the terminal display panel at the current moment compared with the preset reference plane Angle of deviation.

The deviation angle is the included angle between the display panel of the terminal and the preset reference plane at the current moment.

The electronic terminal device can calculate the rotation time from the start of the terminal display panel to the current moment, obtain the preset angle, calculate the number of rotations of the terminal display panel during the rotation time, and obtain the deviation angle of the terminal display panel at the current moment.

In another embodiment of the present invention, the electronic terminal device can also use the built-in gyro sensor to obtain the deviation of the terminal display panel corresponding to the rotation of the preset angle from the preset reference plane at the current moment. angle. Through the built-in gyro sensor, the deviation angle of the terminal display panel at the current moment compared with the preset reference plane can be directly obtained, which saves calculation time of the electronic terminal equipment.

Step S222: Project the obtained screen rendering picture onto the preset reference plane according to the deviation angle.

Fig. 3 is a schematic diagram of an example of the present invention projecting a screen rendering picture onto a preset reference plane. As shown in Fig. 3, the preset angle is 10°, and the angle between the terminal display panel and the preset reference plane at time t3 is 20° ° position, rotate to the position where the included angle with the preset datum plane is 30°. According to the 30° included angle between the terminal display panel and the preset reference plane, the projection direction is obtained, and the screen rendering image is projected to the preset reference plane.

In the embodiment of the present invention, before the terminal display panel displays the picture, the deviation angle of the terminal display panel at the current moment compared with the preset reference plane is obtained, and according to the deviation angle, the screen rendering picture obtained at the current moment is projected onto the preset reference plane, Make the terminal display panel display the screen rendering picture projected to the preset reference plane at the current moment, so that the screen display picture does not rotate with the terminal display panel, does not deviate from the user's original line of sight with the terminal display panel, and ensures that every time the terminal display panel rotates At this moment, all the screen displays on the preset reference plane are displayed.

Another embodiment of the present invention proposes another implementation method of projecting a screen rendering picture to a preset reference plane. In the embodiment of the present invention, the screen rendering picture is formed by multiple screen rendering canvases. The same image data can be rendered based on different display angles to obtain multiple different screen rendering canvases. For example, the image data of a tree is modified to render the shooting angle data to obtain a screen rendering canvas that displays a tree based on 45° and displays a tree based on 90°. In order to significantly enhance the details of the image, when the image acquisition device collects images or videos, it also collects images or videos based on different angles to obtain different image data obtained by shooting the same target. The GPU module of the electronic terminal device renders Get at least one different screen rendering canvas.

The obtained at least one screen rendering canvas overlay can obtain a screen rendering picture.

Step S21 includes sub-step S211: Obtain at least one screen rendering canvas corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment; where the rendering canvases for different screens are based on different display angles; the at least one screen rendering The canvas is used to form the screen rendering picture.

The at least one screen rendering canvas corresponding to the terminal display panel at the current moment is at least one screen rendering canvas rendered by the electronic terminal device at the current moment.

Based on the at least one screen rendering canvas, the step of projecting the screen rendering picture formed by the at least one screen rendering canvas to a preset reference plane includes:

Step S22-1: Input the display angle based on rendering each screen rendering canvas and the deviation angle into the preset compensation angle calculation model to obtain the projection position of each screen rendering canvas; wherein at least one of the screen rendering canvases The projection position of is coincident with the position of the preset reference plane.

The preset compensation angle calculation model can be debugged to obtain the projection position of the screen rendering canvas according to the display angle on which the screen rendering canvas is based and the deviation angle of the terminal display panel at the current moment. For example, the electronic terminal equipment obtains the screen rendering canvas A2 based on the display angle of 45°, and the deviation angle between the terminal display panel and the preset reference plane is 60°, directly projecting the screen rendering canvas A2 to the preset reference plane will cause the screen rendering canvas The display angle of A2 is no longer 60°; the compensation angle calculation model can get the projection position of the rendering canvas A2 through adaptive debugging based on the display angle of 45°. The screen rendering canvas is projected to its own projection position, which can enhance the display details of the screen rendering canvas projected to the preset reference plane.

The preset compensation angle calculation model can also be based on the number of at least one screen rendering canvas, combined with the deviation angle of the terminal display panel at the current moment, and the display angle based on each screen rendering canvas, so as to superimpose a The extreme screen at the current moment is used as a debugging benchmark, and the projection position of each screen rendering canvas is output.

A screen rendering canvas whose display angle is 90° among at least one of the screen rendering canvases may be used as a target screen rendering canvas projected to a preset reference plane. The screen rendering canvas that can best display image details on the preset reference plane can be used as the target screen rendering canvas projected to the preset reference plane. It is also possible to use the screen rendering canvas that is projected to the preset reference plane and meets the user's best viewing angle obtained after the calculation of the preset compensation angle calculation model as the target screen rendering canvas projected to the preset reference plane. For example, the user's best viewing angle is 50°, the display angle of the screen rendering canvas A3 is 70 degrees, and the deviation angle of the terminal display panel at the current time is 10 degrees. After the calculation of the preset compensation angle calculation model, the screen rendering canvas A3 After projecting to the preset reference plane, the display angle is 50°, then use the screen rendering canvas A3 as the target screen rendering canvas, and make sure that the projection position of the screen rendering canvas A3 coincides with the position of the preset reference plane.

The target screen rendering canvas whose projection position coincides with the position of the preset reference plane may be predetermined, or may be obtained through debugging of a preset compensation angle calculation model.

Step S22-2: Project each screen rendering canvas to its corresponding projection position.

Step S22-3: Based on the screen rendering canvases projected to the preset reference plane, superimpose the at least one screen rendering canvas projected to their corresponding projection positions to obtain a screen display image on the preset reference plane.

FIG. 4 is a schematic diagram of projecting a screen rendering picture formed by at least one screen rendering canvas onto a preset reference plane according to an example of the present invention. As shown in FIG. 4 , the deviation angle between the terminal display panel 40 and the preset reference plane 45 is 30° , the screen rendering canvas 41, screen rendering canvas 42, screen rendering canvas 43, and screen rendering canvas 44 corresponding to the terminal display panel at the current moment, through the preset compensation angle calculation model, the projection position of the screen rendering canvas 41 and the preset The included angle of the reference plane 45 is 5°. After debugging, the projection position of the screen rendering canvas 42 coincides with the position of the preset reference plane 45. After debugging, the included angle between the projection position of the screen rendering canvas 43 and the preset reference plane 45 is 15°. After debugging, the included angle between the projection position of the screen rendering canvas 44 and the preset reference plane 45 is 20°. Project the screen rendering canvas 41, the screen rendering canvas 42, the screen rendering canvas 43, and the screen rendering canvas 44 to their respective projection positions, and superimpose the screen rendering canvas 41 and the screen rendering canvas 42 based on the screen rendering canvas 42 projected to the preset reference plane 45. The canvas 42 , the screen rendering canvas 43 , and the screen rendering canvas 44 display superimposed images on the preset reference plane 45 to obtain an image that compensates for the deviation angle of the terminal display panel 40 at the current moment.

In the embodiment of the present invention, before the terminal display panel displays the picture, at least one screen rendering canvas for forming the screen rendering picture is obtained first, and the preset compensation angle calculation model is used, according to the display angle based on each screen rendering canvas, and the terminal display The deviation angle of the panel at the current moment compared with the preset reference plane is used to obtain the projection position of each screen rendering canvas, and each screen rendering canvas is projected to its respective projection position, and the screen rendering canvas projected to the preset reference screen Basically, the screen rendering canvas projected to different positions is superimposed to form a screen rendering image that has been projected to the preset reference image. In the above method, the present invention no longer directly stacks multiple screen rendering canvases to obtain the screen rendering picture, but projects the screen rendering canvas to an appropriate position based on different screen rendering canvas display angles, and then forms the screen rendering canvas. At this time, the projection The screen rendering canvases at different positions can enhance the details of the screen rendering canvas projected to the preset reference picture. The screen rendering picture formed by the superposition of each screen rendering canvas has been projected to the preset reference plane, and based on each display angle. The deviation of the user's line of sight caused by the rotation of the terminal display panel.

An embodiment of the present invention proposes yet another implementation method for projecting a screen rendering image onto a preset reference plane, the steps of which include:

Step S222-1: Obtain the deviation direction of the deviation angle compared to the preset reference plane.

The deviation direction is the direction in which the display panel of the terminal rotates at the current moment.

The electronic terminal device can calculate the relative position between the current position of the terminal display panel and the preset reference plane, and obtain the deviation direction of the deviation angle compared with the preset reference plane.

In another embodiment of the present invention, the electronic terminal device may obtain a deviation direction of the deviation angle from the preset reference plane through a built-in acceleration sensor. Through the built-in acceleration sensor, the deviation direction of the terminal display panel at the current moment compared with the preset reference plane can be directly obtained, which saves the calculation time of the electronic terminal equipment.

Step S222-2: Project the obtained screen rendering picture onto the preset reference plane along a target direction opposite to the deviation direction.

The embodiment of the present invention can project the screen rendering picture to the preset reference plane along the target direction opposite to the deviation direction, without calculating parameters such as the projection direction, which saves computing time and computing memory of the electronic terminal device.

Another embodiment of the present invention is to solve the problem that the screen rendering picture is projected onto the preset reference plane, and the screen display picture finally displayed on the preset reference plane does not match the size of the terminal display panel. A reference plane is set to generate a display window matching the size of the screen display. Then project the obtained screen rendering image into the display window of the preset reference plane, optimize the display effect of the terminal display panel, and ensure the aesthetic appearance of the display interface of the terminal display panel.

Fig. 5 is a flow chart of an exemplary electronic terminal device performing a screen display method according to the present invention. As shown in Fig. 5, the steps of screen display include:

Step S51: Detect whether the display panel of the terminal has been rotated away from its last plane.

Step S52: When it is detected that the terminal display panel has deviated from its previous rotation, the deviation angle of the terminal display panel at the current moment compared with the preset reference plane is obtained through the gyro sensor. Through the acceleration sensor, the deviation direction of the deviation angle compared with the preset reference plane is obtained.

Step S53: The CPU of the electronic terminal device generates a display window of the terminal display panel according to the deviation angle and deviation direction, and the size of the generated display window matches the size of the screen display finally displayed on the terminal display panel.

Step S54: The electronic terminal device obtains the projection position of each screen rendering canvas in the at least one screen rendering canvas corresponding to the current moment according to the deviation angle and deviation direction. During rendering to obtain the screen rendering canvas, the GPU of the electronic terminal device projects the screen rendering canvas to the projection position, superimposes multiple screen rendering canvases, and obtains a screen display image for displaying on the terminal display panel.

GPU renders font effects and adjusts the shadow effect of fonts.

Step S55: Send the screen display image to the LCD panel for display. The obtained screen rendering picture is the screen rendering picture projected on the preset reference plane. During the rotation process of the terminal display panel, the reverse rotation of the screen rendering picture is realized, so that during the rotation process of the terminal display panel, the screen rendering picture can be projected to The screen display image obtained by presetting the reference plane can compensate the rotation angle of the display panel of the terminal.

FIG. 6 is an effect diagram of a display screen displayed on a display panel of a terminal after being processed by a screen display method proposed by an example of the present invention. As shown in Figure 6, the screen display method proposed by the embodiment of the present invention generates a screen display screen that is always located on a preset reference plane, thereby ensuring that the angle between the screen display screen and the user's line of sight is always constant during the rotation of the terminal display panel Therefore, the rotation of the display panel of the terminal will not affect the viewing sight of the user, which improves the experience of the user.

Fig. 7 is a functional module diagram of a screen display device proposed by an embodiment of the present invention. The above screen display device is set in a terminal device, as shown in Fig. 7 , the device includes:

The rotation module 71 is used to obtain the screen rendering picture corresponding to the terminal display panel corresponding to the rotation preset angle at the current moment when the terminal display panel is rotated by a preset angle compared with the preset reference plane;

The screen display picture obtaining module 72 is configured to project the obtained screen rendering picture onto the preset reference plane to obtain a screen display picture on the preset reference plane.

The screen display device provided by the embodiment shown in FIG. 8 can be used to implement the technical solutions of the method embodiments shown in FIGS. 1 to 6 in this specification. For its realization principle and technical effect, further reference can be made to the relevant descriptions in the method embodiments.

Optionally, the screen display frame acquisition module includes:

Optionally, the first projection submodule includes:

Optionally, the rotating module includes:

The screen display frame acquisition module includes:

The overlay sub-module is configured to superimpose the at least one screen rendering canvas projected to each corresponding projection position based on the screen rendering canvas projected onto the preset reference plane, to obtain a screen display picture on the preset reference plane.

Optionally, the device also includes:

The screen display frame acquisition module includes:

Optionally, the submodule for obtaining the deviation angle includes:

Optionally, the deviation direction obtaining subunit is specifically configured to obtain the deviation direction of the deviation angle compared with the preset reference plane through a built-in acceleration sensor.

The apparatus provided in the above-mentioned embodiments may be, for example, a chip or a chip module. The device provided by the above-mentioned embodiment is used to implement the technical solution of the above-mentioned method embodiment, and its implementation principle and technical effect can further refer to the relevant description in the method embodiment, and will not be repeated here.

Regarding each module/unit contained in each device described in the above embodiments, it may be a software module/unit, or a hardware module/unit, or may be partly a software module/unit and partly a hardware module/unit. For example, for each device applied to or integrated in a chip, each module/unit contained therein may be realized by hardware such as a circuit, or at least part of the modules/units may be realized by a software program, and the software program runs on For the processor integrated in the chip, the remaining modules/units can be realized by hardware such as circuits; for each device applied to or integrated in the chip module, each module/unit contained in it can be realized by hardware such as circuits , different modules/units can be located in the same component of the chip module (such as chips, circuit modules, etc.) The internally integrated processor and the rest of the modules/units can be realized by hardware such as circuits; for each device applied to or integrated in electronic terminal equipment, each module/unit contained in it can be realized by hardware such as circuits. Different modules/units may be located in the same component (for example, chip, circuit module, etc.) or in different components in the electronic terminal equipment, or at least some modules/units may be implemented in the form of software programs that run on the electronic terminal equipment The internally integrated processor and the remaining (if any) modules/units can be realized by means of hardware such as circuits.

FIG. 9 is a schematic structural diagram of an electronic terminal device provided by an embodiment of the present invention. The electronic terminal device 200 includes a processor 210, a memory 211, and a computer program stored in the memory 211 and operable on the processor 210. When the processor 210 executes the program, the steps in the foregoing method embodiments are implemented. The electronic terminal device provided in the embodiment can be used to implement the technical solution of the method embodiment shown above. For its realization principle and technical effect, please refer to the method Relevant descriptions in the embodiments will not be repeated here.

Fig. 9 is a schematic structural diagram of a terminal device provided by an embodiment of this specification. As shown in Fig. 9, the above-mentioned terminal device may include at least one processor; and at least one memory communicated with the above-mentioned processor, wherein: The program instructions executed by the processor, the processor calling the program instructions can execute the screen display method provided by the embodiments shown in FIGS. 1 to 6 of this specification.

The screen display method provided by the embodiments shown in FIGS. 1 to 6 can be implemented by the following electronic terminal equipment: a chip or a chip module.

Wherein, the above-mentioned terminal device may be an intelligent electronic device such as a smart phone, a tablet computer, or a notebook computer, and the form of the above-mentioned terminal device is not limited in this embodiment.

It can be understood that, the structure shown in the embodiment of the present invention does not constitute a specific limitation on the terminal device 100 . In other embodiments of the present invention, the terminal device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.

The processor 110 executes various functional applications and data processing by running the programs stored in the internal memory 121 , for example, realizing the screen display method provided by the embodiments shown in FIGS. 1 to 6 of the present invention.

The wireless communication function of the terminal device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the terminal device 100 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The terminal device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The terminal device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.

The ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 193 .

Camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The internal memory 121 may be used to store computer-executable program codes including instructions. The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like. The storage data area can store data created during the use of the terminal device 100 (such as audio data, phonebook, etc.) and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like. The processor 110 executes various functional applications and data processing of the terminal device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

An embodiment of the present invention provides a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions cause the computer to execute the embodiments shown in Figures 1 to 6 of this specification Provided screen display method.

A non-transitory computer-readable storage medium may be, for example, a chip or a chip module. Any combination of one or more computer-readable media may be used for the above-mentioned non-transitory computer-readable storage medium. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more conductors, portable computer disks, hard disks, random access memory (RAM), read only memory , ROM), erasable programmable read only memory (erasable programmable read only memory, EPROM) or flash memory, optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any of the above the right combination. In this document, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a data signal carrying computer readable program code in baseband or as part of a carrier wave traveling as a data signal. Such propagated data signals may take many forms, including - but not limited to - electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. .

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including - but not limited to - wireless, wire, optical cable, radio frequency (RF), etc., or any suitable combination of the foregoing.

Computer program code for carrying out the operations described herein can be written in one or more programming languages, or combinations thereof, including object-oriented programming languages—such as Java, Smalltalk, C++, and conventional Procedural Programming Language - such as "C" or a similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer such as use an Internet service provider to connect via the Internet).

The foregoing describes specific embodiments of this specification. Other implementations are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. Multitasking and parallel processing are also possible or may be advantageous in certain embodiments.

In the description of the embodiments of the present invention, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that the descriptions described in conjunction with the embodiments or examples A particular feature, structure, material, or characteristic is included in at least one embodiment or example of the present specification. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of this specification, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing custom logical functions or steps of a process , and the scope of preferred embodiments of this specification includes alternative implementations in which functions may be performed out of the order shown or discussed, including in substantially simultaneous fashion or in reverse order depending on the functions involved, which shall It should be understood by those skilled in the art to which the embodiments of this specification belong.

Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrases "if determined" or "if detected (the stated condition or event)" could be interpreted as "when determined" or "in response to the determination" or "when detected (the stated condition or event) )" or "in response to detection of (a stated condition or event)".

It should be noted that the terminals involved in the embodiments of the present invention may include, but are not limited to, personal computers (personal computers, PCs), personal digital assistants (personal digital assistants, PDAs), wireless handheld devices, tablet computers (tablet computers), Mobile phones, MP3 players, MP4 players, etc.

In the several embodiments provided in this specification, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined Or it can be integrated into another system, or some features can be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

In addition, each functional unit in each embodiment of this specification may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software functional units.

The above-mentioned integrated units implemented in the form of software functional units may be stored in a computer-readable storage medium. The above-mentioned software functional units are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or processor (processor) to execute the methods described in the various embodiments of this specification. partial steps. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and other media capable of storing program codes.

The above is only a specific implementation of the present invention, and any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention, which should be covered by the protection scope of the present invention. The protection scope of the present invention shall be determined by the protection scope of the claims.

Claims

A screen display method, characterized in that it is applied to electronic terminal equipment, and the method includes:

When the terminal display panel is compared with the preset reference plane, every time the preset angle is rotated, the screen rendering picture corresponding to the terminal display panel corresponding to the rotated preset angle at the current moment is obtained;

and projecting the obtained screen rendering image onto the preset reference plane to obtain a screen display image on the preset reference plane.
The method according to claim 1, wherein the projecting the obtained screen rendering picture onto the preset reference plane comprises:

When the terminal display panel is compared with the preset reference plane, each time the preset angle is rotated, the deviation angle of the terminal display panel corresponding to the preset rotation angle at the current moment compared with the preset reference plane is obtained;

Projecting the obtained screen rendering picture to the preset reference plane according to the deviation angle.
The method according to claim 2, wherein projecting the obtained screen rendering picture onto the preset reference plane according to the deviation angle comprises:

Obtaining the deviation direction of the deviation angle compared to the preset reference plane;

Projecting the obtained screen rendering picture onto the preset reference plane along a target direction opposite to the deviation direction.
The method according to claim 2, wherein the obtaining the screen rendering picture corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment comprises:

Obtaining at least one screen rendering canvas corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment; wherein, different screen rendering canvases are rendered based on different display angles; the at least one screen rendering canvas is used to form the screen rendering screen;

The obtained screen rendering picture is projected onto the preset reference plane to obtain a screen display picture on the preset reference plane, including:

Input the display angle and the deviation angle based on which each screen rendering canvas is rendered into the preset compensation angle calculation model to obtain the projection position of each screen rendering canvas; wherein, the projection position of at least one of the screen rendering canvases is the same as the The positions of the above-mentioned preset datum planes coincide;

Project each screen rendering canvas to their corresponding projection positions;

Based on the screen rendering canvases projected to the preset reference plane, the at least one screen rendering canvas projected to respective corresponding projection positions are superimposed to obtain a screen display image on the preset reference plane.
The method according to claim 2, further comprising:

Generate a display window matching the size of the screen display on the preset reference plane according to the deviation angle;

The projecting the obtained screen rendering picture to the preset reference plane includes:

Projecting the obtained screen rendering picture into the display window of the preset reference plane.
The method according to claim 2, wherein the obtaining the deviation angle of the terminal display panel corresponding to the preset angle of rotation relative to the preset reference plane at the current moment comprises:

By using the built-in gyro sensor, the deviation angle of the terminal display panel corresponding to the rotation of the preset angle compared with the preset reference plane at the current moment is obtained.
The method according to claim 3, wherein said obtaining the deviation direction of the deviation angle compared to the preset reference plane;

A deviation direction of the deviation angle compared to the preset reference plane is obtained through a built-in acceleration sensor.
A screen display device is characterized in that it is set on an electronic terminal device, and the device includes:

The rotation module is used to obtain the screen rendering picture corresponding to the terminal display panel corresponding to the rotation preset angle at the current moment when the terminal display panel is rotated by a preset angle compared with the preset reference plane;

The screen display image obtaining module is configured to project the obtained screen rendering image onto the preset reference plane to obtain a screen display image on the preset reference plane.
The device according to claim 8, wherein the screen display image acquisition module comprises:

The deviation angle obtaining sub-module is used to obtain the corresponding rotation preset angle of the terminal display panel at the current moment compared with the preset reference plane every time the terminal display panel rotates a preset angle. The deviation angle of the preset datum plane;

The first projecting sub-module is configured to project the obtained screen rendering picture to the preset reference plane according to the deviation angle.
The device according to claim 9, wherein the first projecting submodule comprises:

a deviation direction obtaining subunit, configured to obtain a deviation direction of the deviation angle compared with the preset reference plane;

The target direction projecting subunit is configured to project the obtained screen rendering picture onto the preset reference plane along a target direction opposite to the deviation direction.
The device according to claim 9, wherein the rotating module comprises:

The rendering sub-module is used to obtain at least one screen rendering canvas corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment; wherein, the display angles on which different screen rendering canvases are rendered are different; the at least one screen rendering canvas for forming the screen rendering picture;

The screen display frame acquisition module includes:

The input sub-module is used to input the display angle based on rendering each screen rendering canvas and the deviation angle into the preset compensation angle calculation model to obtain the projection position of each screen rendering canvas; wherein at least one of the screen rendering The projection position of the canvas coincides with the position of the preset reference plane;

The second projecting sub-module is used to project each screen rendering canvas to its corresponding projecting position;

The superposition sub-module is configured to superimpose the at least one screen rendering canvas projected to each corresponding projection position based on the screen rendering canvas projected to the preset reference plane, to obtain the screen display picture on the preset reference plane.
The device according to claim 9, wherein the device further comprises:

A generating module, configured to generate a display window matching the size of the screen display on the preset reference plane according to the deviation angle;

The screen display frame acquisition module includes:

The third projecting sub-module is configured to project the obtained screen rendering picture into the display window of the preset reference plane.
The device according to claim 9, wherein the deviation angle obtaining submodule comprises:

The deviation angle acquisition subunit is configured to obtain, through a built-in gyro sensor, a deviation angle of the terminal display panel that is rotated corresponding to the preset angle relative to the preset reference plane at the current moment.
The device according to claim 10, wherein the deviation direction obtaining subunit is specifically configured to obtain a deviation direction of the deviation angle compared to the preset reference plane through a built-in acceleration sensor.
A terminal device, comprising:

at least one processor; and

At least one memory communicatively coupled to said processor, characterized by:

The memory stores program instructions executable by the processor, and the processor calls the program instructions to execute the method according to any one of claims 1 to 7.
A non-transitory (non-volatile) computer-readable storage medium, the non-transitory computer-readable storage medium stores computer instructions, characterized in that, the computer instructions cause the computer to execute claims 1 to 7 any of the methods described.