[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2023061325A1 - Procédé et appareil d'affichage d'image, dispositif terminal et support de stockage - Google Patents

Procédé et appareil d'affichage d'image, dispositif terminal et support de stockage Download PDF

Info

Publication number
WO2023061325A1
WO2023061325A1 PCT/CN2022/124352 CN2022124352W WO2023061325A1 WO 2023061325 A1 WO2023061325 A1 WO 2023061325A1 CN 2022124352 W CN2022124352 W CN 2022124352W WO 2023061325 A1 WO2023061325 A1 WO 2023061325A1
Authority
WO
WIPO (PCT)
Prior art keywords
reference plane
preset reference
screen
angle
screen rendering
Prior art date
Application number
PCT/CN2022/124352
Other languages
English (en)
Chinese (zh)
Inventor
任前山
Original Assignee
展讯通信（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 展讯通信（深圳）有限公司 filed Critical 展讯通信（深圳）有限公司
Publication of WO2023061325A1 publication Critical patent/WO2023061325A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures

Definitions

  • the present application relates to the technical field of smart terminals, and in particular to a screen display method, device terminal equipment, and storage media.
  • the electronic terminal device will rotate due to external force or the use of the operator, the electronic terminal device will rotate, the display panel will deviate from the user's original line of sight, and the angle of the user's viewing screen will also deviate accordingly.
  • the electronic terminal device rotates to From a certain angle, the user cannot clearly see the complete picture displayed on the display panel based on the original line of sight, resulting in a poor user experience.
  • Embodiments of the present invention provide a screen display method, device, terminal device, and storage medium.
  • a dynamic screen display image is obtained, and the dynamic screen display image is used to compensate the rotation angle of the electronic terminal device. Ensure that the angle between the user's line of sight and the screen display is always at the best angle for viewing the screen.
  • an embodiment of the present invention provides a screen display method, which is applied to an electronic device terminal.
  • the method includes: comparing the terminal display panel with a preset reference plane, each time the preset angle is rotated, the corresponding preset angle of rotation is obtained.
  • the obtained screen rendering picture is not directly displayed on the terminal display panel, but the obtained screen rendering picture is projected onto the preset reference plane, and then projected onto the preset reference plane.
  • the flat screen display screen is displayed on the terminal display panel.
  • the projecting the obtained screen rendering picture to the preset reference plane includes:
  • the projecting the obtained screen rendering picture to the preset reference plane according to the deviation angle includes:
  • the obtaining the screen rendering picture corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment includes:
  • Projecting the obtained screen rendering picture onto the preset reference plane to obtain a screen display picture on the preset reference plane including:
  • the at least one screen rendering canvas projected to respective corresponding projection positions are superimposed to obtain a screen display image on the preset reference plane.
  • the method further includes:
  • the projecting the obtained screen rendering picture to the preset reference plane includes:
  • the obtaining the deviation angle of the terminal display panel corresponding to the preset rotation angle compared with the preset reference plane at the current moment includes:
  • the deviation angle of the terminal display panel corresponding to the rotation of the preset angle compared with the preset reference plane at the current moment is obtained.
  • the obtaining the deviation direction of the deviation angle compared to the preset reference plane the obtaining the deviation direction of the deviation angle compared to the preset reference plane
  • a deviation direction of the deviation angle compared to the preset reference plane is obtained through a built-in acceleration sensor.
  • an embodiment of the present invention provides a screen display device, which is set in an electronic device terminal, and the device includes:
  • the rotation module is used to obtain the screen rendering picture corresponding to the terminal display panel corresponding to the rotation preset angle at the current moment when the terminal display panel is rotated by a preset angle compared with the preset reference plane;
  • the screen display image obtaining module is configured to project the obtained screen rendering image onto the preset reference plane to obtain a screen display image on the preset reference plane.
  • the screen display image acquisition module includes:
  • the deviation angle obtaining sub-module is used to obtain the corresponding rotation preset angle of the terminal display panel at the current moment compared with the preset reference plane every time the terminal display panel rotates a preset angle.
  • the first projecting sub-module is configured to project the obtained screen rendering picture to the preset reference plane according to the deviation angle.
  • the first projecting submodule includes:
  • a deviation direction obtaining subunit configured to obtain a deviation direction of the deviation angle compared with the preset reference plane
  • the target direction projecting subunit is configured to project the obtained screen rendering picture onto the preset reference plane along a target direction opposite to the deviation direction.
  • the rotating module includes:
  • the rendering sub-module is used to obtain at least one screen rendering canvas corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment; wherein, the display angles on which different screen rendering canvases are rendered are different; the at least one screen rendering canvas for forming the screen rendering picture;
  • the screen display frame acquisition module includes:
  • the input sub-module is used to input the display angle based on rendering each screen rendering canvas and the deviation angle into the preset compensation angle calculation model to obtain the projection position of each screen rendering canvas; wherein at least one of the screen rendering The projection position of the canvas coincides with the position of the preset reference plane;
  • the second projecting sub-module is used to project each screen rendering canvas to its corresponding projecting position
  • the superposition sub-module is configured to superimpose the at least one screen rendering canvas projected to their corresponding projection positions based on the screen rendering canvases projected on the preset reference plane, to obtain a screen display picture on the preset reference plane.
  • the device further includes:
  • a generating module configured to generate a display window matching the size of the screen display on the preset reference plane according to the deviation angle
  • the screen display frame acquisition module includes:
  • the third projecting sub-module is configured to project the obtained screen rendering picture into the display window of the preset reference plane.
  • the submodule for obtaining the deviation angle includes:
  • the deviation angle acquisition subunit is configured to obtain, through a built-in gyro sensor, a deviation angle of the terminal display panel that is rotated corresponding to the preset angle relative to the preset reference plane at the current moment.
  • the deviation direction obtaining subunit is specifically configured to obtain a deviation direction of the deviation angle compared with the preset reference plane through a built-in acceleration sensor.
  • an embodiment of the present invention provides a terminal device, including: at least one processor; and at least one memory communicated with the processor, wherein: the memory stores a program executable by the processor Instructions, the processor invokes the program instructions to execute the method provided in the first aspect.
  • an embodiment of the present invention provides a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions cause the computer to execute the method provided in the first aspect.
  • Fig. 1 is a schematic diagram of rotation of a terminal display panel of an electronic terminal device
  • FIG. 2 is a flow chart of the steps of the screen display method proposed by the embodiment of the present invention.
  • Fig. 3 is a schematic diagram of projecting a screen rendering picture to a preset reference plane according to an example of the present invention
  • Fig. 4 is a schematic diagram of projecting a screen rendering picture formed by at least one screen rendering canvas to a preset reference plane according to an example of the present invention
  • Fig. 5 is a flow chart of an exemplary electronic terminal device execution screen display method according to the present invention.
  • Fig. 6 is an effect diagram of a terminal display panel display screen display screen after being processed by a screen display method proposed by an example of the present invention
  • FIG. 7 is a functional block diagram of a screen display device proposed by an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of an electronic terminal device provided by an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of a terminal device provided by an embodiment of this specification.
  • Figure 1 is a schematic diagram of the rotation of the terminal display panel of the electronic terminal device.
  • the angle between the terminal display panel 11 and the user's line of sight is 90°, and the user is at the best viewing angle.
  • the rotation deviates from its original plane, the angle between the rotated terminal display panel 12 and the user's line of sight is 120°, and the rotated terminal display panel 12 deviates from the best viewing angle for the user.
  • the user has to adjust his line of sight in order to watch the complete picture displayed by the rotated terminal display panel 12, resulting in poor user experience.
  • an embodiment of the present invention proposes a picture display method for electronic terminal equipment, electronic terminal equipment It may be an electronic device carrying a display panel such as a tablet, a computer, or a mobile phone.
  • Fig. 2 is a flow chart of the steps of the screen display method proposed by the embodiment of the present invention. As shown in Fig. 2, the steps include:
  • Step S21 Obtain a screen rendering picture corresponding to the current moment of the terminal display panel corresponding to the preset rotation angle every time the terminal display panel is rotated by a preset angle compared with the preset reference plane.
  • the preset reference plane is a preset horizontal plane or vertical plane in the electronic terminal equipment.
  • the preset angle can be any value. According to the accuracy setting of the display screen of the terminal display panel, the smaller the preset angle is, the higher the frequency that the electronic terminal device obtains the screen rendering image and projects the screen rendering image to the preset reference plane , the better the screen display effect presented by the terminal display panel is.
  • the screen rendering picture is a picture output by the electronic terminal device according to the current picture data, and the GPU module of the electronic terminal device can be used to render the screen rendering picture according to the current picture data.
  • the screen display picture is a picture displayed on the display panel of the terminal.
  • Step S22 Projecting the obtained screen rendering image onto the preset reference plane to obtain a screen display image on the preset reference plane.
  • the preset angle is 1°.
  • the terminal display panel coincides with the preset reference plane, t1 the electronic terminal device rotates 1°, and the angle between the terminal display panel and the preset reference plane is is 1°, obtain the screen rendering picture A1 output according to the image data at time t1, and project the screen rendering picture A1 onto the preset reference plane;
  • the electronic terminal equipment rotates 1°, and the angle between the terminal display panel and the preset reference plane is 2° , obtain the screen rendering picture A2 output according to the image data at time t2, and project the screen rendering picture A2 onto the preset reference plane;
  • the electronic terminal equipment rotates 1°, the angle between the terminal display panel and the preset reference plane is 3°, and t3 is obtained According to the screen rendering picture A3 output by the image data at all times, the screen rendering picture A3 is projected to the preset reference plane; when the terminal display panel rotates with itself, the electronic terminal equipment will turn the current screen rendering picture
  • the electronic terminal device instead of directly displaying the obtained screen rendering picture on the terminal display panel, it projects the obtained screen rendering picture onto a preset reference plane before displaying the picture on the terminal display panel, and then The screen display screen projected onto the preset reference plane is displayed on the terminal display panel.
  • the screen displayed on the terminal display panel is always at the user's Optimal viewing position in line of sight.
  • Another embodiment of the present invention proposes an implementation method for projecting a screen rendering image onto a preset reference plane, the steps of which include:
  • Step S221 When the terminal display panel is compared with the preset reference plane, each time the preset angle is rotated, obtain the corresponding rotation preset angle of the terminal display panel at the current moment compared with the preset reference plane Angle of deviation.
  • the deviation angle is the included angle between the display panel of the terminal and the preset reference plane at the current moment.
  • the electronic terminal device can calculate the rotation time from the start of the terminal display panel to the current moment, obtain the preset angle, calculate the number of rotations of the terminal display panel during the rotation time, and obtain the deviation angle of the terminal display panel at the current moment.
  • the electronic terminal device can also use the built-in gyro sensor to obtain the deviation of the terminal display panel corresponding to the rotation of the preset angle from the preset reference plane at the current moment. angle.
  • the built-in gyro sensor Through the built-in gyro sensor, the deviation angle of the terminal display panel at the current moment compared with the preset reference plane can be directly obtained, which saves calculation time of the electronic terminal equipment.
  • Step S222 Project the obtained screen rendering picture onto the preset reference plane according to the deviation angle.
  • Fig. 3 is a schematic diagram of an example of the present invention projecting a screen rendering picture onto a preset reference plane.
  • the preset angle is 10°
  • the angle between the terminal display panel and the preset reference plane at time t3 is 20° ° position, rotate to the position where the included angle with the preset datum plane is 30°.
  • the projection direction is obtained, and the screen rendering image is projected to the preset reference plane.
  • the deviation angle of the terminal display panel at the current moment compared with the preset reference plane is obtained, and according to the deviation angle, the screen rendering picture obtained at the current moment is projected onto the preset reference plane, Make the terminal display panel display the screen rendering picture projected to the preset reference plane at the current moment, so that the screen display picture does not rotate with the terminal display panel, does not deviate from the user's original line of sight with the terminal display panel, and ensures that every time the terminal display panel rotates At this moment, all the screen displays on the preset reference plane are displayed.
  • the screen rendering picture is formed by multiple screen rendering canvases.
  • the same image data can be rendered based on different display angles to obtain multiple different screen rendering canvases.
  • the image data of a tree is modified to render the shooting angle data to obtain a screen rendering canvas that displays a tree based on 45° and displays a tree based on 90°.
  • the image acquisition device collects images or videos, it also collects images or videos based on different angles to obtain different image data obtained by shooting the same target.
  • the GPU module of the electronic terminal device renders Get at least one different screen rendering canvas.
  • the obtained at least one screen rendering canvas overlay can obtain a screen rendering picture.
  • Step S21 includes sub-step S211: Obtain at least one screen rendering canvas corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment; where the rendering canvases for different screens are based on different display angles; the at least one screen rendering The canvas is used to form the screen rendering picture.
  • the at least one screen rendering canvas corresponding to the terminal display panel at the current moment is at least one screen rendering canvas rendered by the electronic terminal device at the current moment.
  • the step of projecting the screen rendering picture formed by the at least one screen rendering canvas to a preset reference plane includes:
  • Step S22-1 Input the display angle based on rendering each screen rendering canvas and the deviation angle into the preset compensation angle calculation model to obtain the projection position of each screen rendering canvas; wherein at least one of the screen rendering canvases The projection position of is coincident with the position of the preset reference plane.
  • the preset compensation angle calculation model can be debugged to obtain the projection position of the screen rendering canvas according to the display angle on which the screen rendering canvas is based and the deviation angle of the terminal display panel at the current moment.
  • the electronic terminal equipment obtains the screen rendering canvas A2 based on the display angle of 45°, and the deviation angle between the terminal display panel and the preset reference plane is 60°, directly projecting the screen rendering canvas A2 to the preset reference plane will cause the screen rendering canvas
  • the display angle of A2 is no longer 60°; the compensation angle calculation model can get the projection position of the rendering canvas A2 through adaptive debugging based on the display angle of 45°.
  • the screen rendering canvas is projected to its own projection position, which can enhance the display details of the screen rendering canvas projected to the preset reference plane.
  • the preset compensation angle calculation model can also be based on the number of at least one screen rendering canvas, combined with the deviation angle of the terminal display panel at the current moment, and the display angle based on each screen rendering canvas, so as to superimpose a
  • the extreme screen at the current moment is used as a debugging benchmark, and the projection position of each screen rendering canvas is output.
  • a screen rendering canvas whose display angle is 90° among at least one of the screen rendering canvases may be used as a target screen rendering canvas projected to a preset reference plane.
  • the screen rendering canvas that can best display image details on the preset reference plane can be used as the target screen rendering canvas projected to the preset reference plane. It is also possible to use the screen rendering canvas that is projected to the preset reference plane and meets the user's best viewing angle obtained after the calculation of the preset compensation angle calculation model as the target screen rendering canvas projected to the preset reference plane.
  • the user's best viewing angle is 50°
  • the display angle of the screen rendering canvas A3 is 70 degrees
  • the deviation angle of the terminal display panel at the current time is 10 degrees.
  • the screen rendering canvas A3 After the calculation of the preset compensation angle calculation model, the screen rendering canvas A3 After projecting to the preset reference plane, the display angle is 50°, then use the screen rendering canvas A3 as the target screen rendering canvas, and make sure that the projection position of the screen rendering canvas A3 coincides with the position of the preset reference plane.
  • the target screen rendering canvas whose projection position coincides with the position of the preset reference plane may be predetermined, or may be obtained through debugging of a preset compensation angle calculation model.
  • Step S22-2 Project each screen rendering canvas to its corresponding projection position.
  • Step S22-3 Based on the screen rendering canvases projected to the preset reference plane, superimpose the at least one screen rendering canvas projected to their corresponding projection positions to obtain a screen display image on the preset reference plane.
  • FIG. 4 is a schematic diagram of projecting a screen rendering picture formed by at least one screen rendering canvas onto a preset reference plane according to an example of the present invention.
  • the deviation angle between the terminal display panel 40 and the preset reference plane 45 is 30°
  • the screen rendering canvas 41, screen rendering canvas 42, screen rendering canvas 43, and screen rendering canvas 44 corresponding to the terminal display panel at the current moment through the preset compensation angle calculation model, the projection position of the screen rendering canvas 41 and the preset
  • the included angle of the reference plane 45 is 5°.
  • the projection position of the screen rendering canvas 42 coincides with the position of the preset reference plane 45.
  • the included angle between the projection position of the screen rendering canvas 43 and the preset reference plane 45 is 15°.
  • the included angle between the projection position of the screen rendering canvas 44 and the preset reference plane 45 is 20°. Project the screen rendering canvas 41, the screen rendering canvas 42, the screen rendering canvas 43, and the screen rendering canvas 44 to their respective projection positions, and superimpose the screen rendering canvas 41 and the screen rendering canvas 42 based on the screen rendering canvas 42 projected to the preset reference plane 45.
  • the canvas 42 , the screen rendering canvas 43 , and the screen rendering canvas 44 display superimposed images on the preset reference plane 45 to obtain an image that compensates for the deviation angle of the terminal display panel 40 at the current moment.
  • the terminal display panel displays the picture
  • at least one screen rendering canvas for forming the screen rendering picture is obtained first, and the preset compensation angle calculation model is used, according to the display angle based on each screen rendering canvas, and the terminal display
  • the deviation angle of the panel at the current moment compared with the preset reference plane is used to obtain the projection position of each screen rendering canvas, and each screen rendering canvas is projected to its respective projection position, and the screen rendering canvas projected to the preset reference screen
  • the screen rendering canvas projected to different positions is superimposed to form a screen rendering image that has been projected to the preset reference image.
  • the present invention no longer directly stacks multiple screen rendering canvases to obtain the screen rendering picture, but projects the screen rendering canvas to an appropriate position based on different screen rendering canvas display angles, and then forms the screen rendering canvas.
  • the projection The screen rendering canvases at different positions can enhance the details of the screen rendering canvas projected to the preset reference picture.
  • the screen rendering picture formed by the superposition of each screen rendering canvas has been projected to the preset reference plane, and based on each display angle. The deviation of the user's line of sight caused by the rotation of the terminal display panel.
  • An embodiment of the present invention proposes yet another implementation method for projecting a screen rendering image onto a preset reference plane, the steps of which include:
  • Step S222-1 Obtain the deviation direction of the deviation angle compared to the preset reference plane.
  • the deviation direction is the direction in which the display panel of the terminal rotates at the current moment.
  • the electronic terminal device can calculate the relative position between the current position of the terminal display panel and the preset reference plane, and obtain the deviation direction of the deviation angle compared with the preset reference plane.
  • the electronic terminal device may obtain a deviation direction of the deviation angle from the preset reference plane through a built-in acceleration sensor.
  • the built-in acceleration sensor Through the built-in acceleration sensor, the deviation direction of the terminal display panel at the current moment compared with the preset reference plane can be directly obtained, which saves the calculation time of the electronic terminal equipment.
  • Step S222-2 Project the obtained screen rendering picture onto the preset reference plane along a target direction opposite to the deviation direction.
  • the embodiment of the present invention can project the screen rendering picture to the preset reference plane along the target direction opposite to the deviation direction, without calculating parameters such as the projection direction, which saves computing time and computing memory of the electronic terminal device.
  • Another embodiment of the present invention is to solve the problem that the screen rendering picture is projected onto the preset reference plane, and the screen display picture finally displayed on the preset reference plane does not match the size of the terminal display panel.
  • a reference plane is set to generate a display window matching the size of the screen display. Then project the obtained screen rendering image into the display window of the preset reference plane, optimize the display effect of the terminal display panel, and ensure the aesthetic appearance of the display interface of the terminal display panel.
  • Fig. 5 is a flow chart of an exemplary electronic terminal device performing a screen display method according to the present invention. As shown in Fig. 5, the steps of screen display include:
  • Step S51 Detect whether the display panel of the terminal has been rotated away from its last plane.
  • Step S52 When it is detected that the terminal display panel has deviated from its previous rotation, the deviation angle of the terminal display panel at the current moment compared with the preset reference plane is obtained through the gyro sensor. Through the acceleration sensor, the deviation direction of the deviation angle compared with the preset reference plane is obtained.
  • Step S53 The CPU of the electronic terminal device generates a display window of the terminal display panel according to the deviation angle and deviation direction, and the size of the generated display window matches the size of the screen display finally displayed on the terminal display panel.
  • Step S54 The electronic terminal device obtains the projection position of each screen rendering canvas in the at least one screen rendering canvas corresponding to the current moment according to the deviation angle and deviation direction.
  • the GPU of the electronic terminal device projects the screen rendering canvas to the projection position, superimposes multiple screen rendering canvases, and obtains a screen display image for displaying on the terminal display panel.
  • GPU renders font effects and adjusts the shadow effect of fonts.
  • Step S55 Send the screen display image to the LCD panel for display.
  • the obtained screen rendering picture is the screen rendering picture projected on the preset reference plane.
  • the reverse rotation of the screen rendering picture is realized, so that during the rotation process of the terminal display panel, the screen rendering picture can be projected to
  • the screen display image obtained by presetting the reference plane can compensate the rotation angle of the display panel of the terminal.
  • FIG. 6 is an effect diagram of a display screen displayed on a display panel of a terminal after being processed by a screen display method proposed by an example of the present invention.
  • the screen display method proposed by the embodiment of the present invention generates a screen display screen that is always located on a preset reference plane, thereby ensuring that the angle between the screen display screen and the user's line of sight is always constant during the rotation of the terminal display panel Therefore, the rotation of the display panel of the terminal will not affect the viewing sight of the user, which improves the experience of the user.
  • Fig. 7 is a functional module diagram of a screen display device proposed by an embodiment of the present invention.
  • the above screen display device is set in a terminal device, as shown in Fig. 7 , the device includes:
  • the rotation module 71 is used to obtain the screen rendering picture corresponding to the terminal display panel corresponding to the rotation preset angle at the current moment when the terminal display panel is rotated by a preset angle compared with the preset reference plane;
  • the screen display picture obtaining module 72 is configured to project the obtained screen rendering picture onto the preset reference plane to obtain a screen display picture on the preset reference plane.
  • the screen display device provided by the embodiment shown in FIG. 8 can be used to implement the technical solutions of the method embodiments shown in FIGS. 1 to 6 in this specification. For its realization principle and technical effect, further reference can be made to the relevant descriptions in the method embodiments.
  • the screen display frame acquisition module includes:
  • the deviation angle obtaining sub-module is used to obtain the corresponding rotation preset angle of the terminal display panel at the current moment compared with the preset reference plane every time the terminal display panel rotates a preset angle.
  • the first projecting sub-module is configured to project the obtained screen rendering picture to the preset reference plane according to the deviation angle.
  • the first projection submodule includes:
  • a deviation direction obtaining subunit configured to obtain a deviation direction of the deviation angle compared with the preset reference plane
  • the target direction projecting subunit is configured to project the obtained screen rendering picture onto the preset reference plane along a target direction opposite to the deviation direction.
  • the rotating module includes:
  • the rendering sub-module is used to obtain at least one screen rendering canvas corresponding to the terminal display panel corresponding to the preset rotation angle at the current moment; wherein, the display angles on which different screen rendering canvases are rendered are different; the at least one screen rendering canvas for forming the screen rendering picture;
  • the screen display frame acquisition module includes:
  • the input sub-module is used to input the display angle based on rendering each screen rendering canvas and the deviation angle into the preset compensation angle calculation model to obtain the projection position of each screen rendering canvas; wherein at least one of the screen rendering The projection position of the canvas coincides with the position of the preset reference plane;
  • the second projecting sub-module is used to project each screen rendering canvas to its corresponding projecting position
  • the overlay sub-module is configured to superimpose the at least one screen rendering canvas projected to each corresponding projection position based on the screen rendering canvas projected onto the preset reference plane, to obtain a screen display picture on the preset reference plane.
  • the device also includes:
  • a generating module configured to generate a display window matching the size of the screen display on the preset reference plane according to the deviation angle
  • the screen display frame acquisition module includes:
  • the third projecting sub-module is configured to project the obtained screen rendering picture into the display window of the preset reference plane.
  • the submodule for obtaining the deviation angle includes:
  • the deviation angle acquisition subunit is configured to obtain, through a built-in gyro sensor, a deviation angle of the terminal display panel that is rotated corresponding to the preset angle relative to the preset reference plane at the current moment.
  • the deviation direction obtaining subunit is specifically configured to obtain the deviation direction of the deviation angle compared with the preset reference plane through a built-in acceleration sensor.
  • the apparatus provided in the above-mentioned embodiments may be, for example, a chip or a chip module.
  • the device provided by the above-mentioned embodiment is used to implement the technical solution of the above-mentioned method embodiment, and its implementation principle and technical effect can further refer to the relevant description in the method embodiment, and will not be repeated here.
  • each module/unit contained in each device described in the above embodiments it may be a software module/unit, or a hardware module/unit, or may be partly a software module/unit and partly a hardware module/unit.
  • each module/unit contained therein may be realized by hardware such as a circuit, or at least part of the modules/units may be realized by a software program, and the software program runs on
  • the remaining modules/units can be realized by hardware such as circuits;
  • each module/unit contained in it can be realized by hardware such as circuits , different modules/units can be located in the same component of the chip module (such as chips, circuit modules, etc.)
  • the internally integrated processor and the rest of the modules/units can be realized by hardware such as circuits; for each device applied to or integrated in electronic terminal equipment, each module/unit contained in it can be realized by hardware such as circuits.
  • modules/units may be located in the same component (for example, chip, circuit module, etc.) or in different components in the electronic terminal equipment, or at least some modules/units may be implemented in the form of software programs that run on the electronic terminal equipment
  • the internally integrated processor and the remaining (if any) modules/units can be realized by means of hardware such as circuits.
  • FIG. 9 is a schematic structural diagram of an electronic terminal device provided by an embodiment of the present invention.
  • the electronic terminal device 200 includes a processor 210, a memory 211, and a computer program stored in the memory 211 and operable on the processor 210.
  • the processor 210 executes the program, the steps in the foregoing method embodiments are implemented.
  • the electronic terminal device provided in the embodiment can be used to implement the technical solution of the method embodiment shown above. For its realization principle and technical effect, please refer to the method Relevant descriptions in the embodiments will not be repeated here.
  • Fig. 9 is a schematic structural diagram of a terminal device provided by an embodiment of this specification.
  • the above-mentioned terminal device may include at least one processor; and at least one memory communicated with the above-mentioned processor, wherein:
  • the program instructions executed by the processor, the processor calling the program instructions can execute the screen display method provided by the embodiments shown in FIGS. 1 to 6 of this specification.
  • the screen display method provided by the embodiments shown in FIGS. 1 to 6 can be implemented by the following electronic terminal equipment: a chip or a chip module.
  • the above-mentioned terminal device may be an intelligent electronic device such as a smart phone, a tablet computer, or a notebook computer, and the form of the above-mentioned terminal device is not limited in this embodiment.
  • the structure shown in the embodiment of the present invention does not constitute a specific limitation on the terminal device 100 .
  • the terminal device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
  • the processor 110 executes various functional applications and data processing by running the programs stored in the internal memory 121 , for example, realizing the screen display method provided by the embodiments shown in FIGS. 1 to 6 of the present invention.
  • the wireless communication function of the terminal device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the terminal device 100 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the terminal device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos and the like.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the terminal device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
  • the ISP is used for processing the data fed back by the camera 193 .
  • the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin color.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the terminal device 100 may support one or more video codecs.
  • the terminal device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
  • the internal memory 121 may be used to store computer-executable program codes including instructions.
  • the internal memory 121 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data created during the use of the terminal device 100 (such as audio data, phonebook, etc.) and the like.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the processor 110 executes various functional applications and data processing of the terminal device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
  • An embodiment of the present invention provides a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions cause the computer to execute the embodiments shown in Figures 1 to 6 of this specification Provided screen display method.
  • a non-transitory computer-readable storage medium may be, for example, a chip or a chip module. Any combination of one or more computer-readable media may be used for the above-mentioned non-transitory computer-readable storage medium.
  • the computer readable medium may be a computer readable signal medium or a computer readable storage medium.
  • a computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • a computer readable signal medium may include a data signal carrying computer readable program code in baseband or as part of a carrier wave traveling as a data signal. Such propagated data signals may take many forms, including - but not limited to - electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. .
  • Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including - but not limited to - wireless, wire, optical cable, radio frequency (RF), etc., or any suitable combination of the foregoing.
  • RF radio frequency
  • Computer program code for carrying out the operations described herein can be written in one or more programming languages, or combinations thereof, including object-oriented programming languages—such as Java, Smalltalk, C++, and conventional Procedural Programming Language - such as "C" or a similar programming language.
  • the program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer such as use an Internet service provider to connect via the Internet).
  • LAN local area network
  • WAN wide area network
  • first and second are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features.
  • the features defined as “first” and “second” may explicitly or implicitly include at least one of these features.
  • “plurality” means at least two, such as two, three, etc., unless otherwise specifically defined.
  • the word “if” as used herein may be interpreted as “at” or “when” or “in response to determining” or “in response to detecting”.
  • the phrases “if determined” or “if detected (the stated condition or event)” could be interpreted as “when determined” or “in response to the determination” or “when detected (the stated condition or event) )” or “in response to detection of (a stated condition or event)”.
  • terminals involved in the embodiments of the present invention may include, but are not limited to, personal computers (personal computers, PCs), personal digital assistants (personal digital assistants, PDAs), wireless handheld devices, tablet computers (tablet computers), Mobile phones, MP3 players, MP4 players, etc.
  • the disclosed systems, devices and methods can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components can be combined Or it can be integrated into another system, or some features can be ignored, or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • each functional unit in each embodiment of this specification may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software functional units.
  • the above-mentioned integrated units implemented in the form of software functional units may be stored in a computer-readable storage medium.
  • the above-mentioned software functional units are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or processor (processor) to execute the methods described in the various embodiments of this specification. partial steps.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and other media capable of storing program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Des modes de réalisation de la présente invention se rapportent au domaine technique des terminaux intelligents, et concernent un procédé et un appareil d'affichage d'image, un dispositif terminal et un support de stockage. Dans le processus de rotation d'un dispositif de terminal électronique, une image d'affichage d'écran dynamique est obtenue, et un angle de rotation du dispositif de terminal électronique est compensé au moyen de l'image d'affichage d'écran dynamique pour s'assurer qu'un angle de la vue d'un utilisateur par rapport à l'image d'affichage d'écran est toujours un angle optimal de visionnage d'image d'écran. Le procédé consiste : chaque fois qu'un panneau d'affichage de terminal tourne selon un angle prédéfini par rapport à un plan de référence prédéfini, à obtenir une image de rendu d'écran correspondant, à un moment actuel, au panneau d'affichage de terminal qui tourne de manière correspondante selon l'angle prédéfini ; et à projeter l'image de rendu d'écran obtenue sur le plan de référence prédéfini pour obtenir une image d'affichage d'écran sur le plan de référence prédéfini.
PCT/CN2022/124352 2021-10-11 2022-10-10 Procédé et appareil d'affichage d'image, dispositif terminal et support de stockage WO2023061325A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111182044.7 2021-10-11
CN202111182044.7A CN113867535B (zh) 2021-10-11 2021-10-11 画面显示方法、装置、终端设备以及存储介质

Publications (1)

Publication Number Publication Date
WO2023061325A1 true WO2023061325A1 (fr) 2023-04-20

Family

ID=78998875

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/124352 WO2023061325A1 (fr) 2021-10-11 2022-10-10 Procédé et appareil d'affichage d'image, dispositif terminal et support de stockage

Country Status (2)

Country Link
CN (1) CN113867535B (fr)
WO (1) WO2023061325A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113867535B (zh) * 2021-10-11 2023-09-05 展讯通信（深圳）有限公司 画面显示方法、装置、终端设备以及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090244267A1 (en) * 2008-03-28 2009-10-01 Sharp Laboratories Of America, Inc. Method and apparatus for rendering virtual see-through scenes on single or tiled displays
CN103365430A (zh) * 2012-04-10 2013-10-23 洪荣昭 移动装置屏幕画面的位移补偿方法
CN109308153A (zh) * 2017-07-27 2019-02-05 先锋高科技(上海)有限公司 画面调整方法及装置、计算机可读存储介质、终端
CN111246266A (zh) * 2020-03-04 2020-06-05 海信视像科技股份有限公司 一种显示设备及旋转时ui显示方法
CN113867535A (zh) * 2021-10-11 2021-12-31 展讯通信（深圳）有限公司 画面显示方法、装置、终端设备以及存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103455256B (zh) * 2013-08-21 2017-09-15 小米科技有限责任公司 旋转屏幕显示画面的方法和终端
CN104679225B (zh) * 2013-11-28 2018-02-02 上海斐讯数据通信技术有限公司 移动终端的屏幕调节方法、屏幕调节装置及移动终端
CN105589293A (zh) * 2016-03-18 2016-05-18 严俊涛 全息投影方法及全息投影系统
CN109960479B (zh) * 2017-12-22 2022-05-17 中科创达软件股份有限公司 一种显示设备抗眩晕的方法及装置
CN112083805A (zh) * 2020-09-03 2020-12-15 深圳市雷鸟网络传媒有限公司 屏幕画面自适应调整方法、装置、设备和存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090244267A1 (en) * 2008-03-28 2009-10-01 Sharp Laboratories Of America, Inc. Method and apparatus for rendering virtual see-through scenes on single or tiled displays
CN103365430A (zh) * 2012-04-10 2013-10-23 洪荣昭 移动装置屏幕画面的位移补偿方法
CN109308153A (zh) * 2017-07-27 2019-02-05 先锋高科技(上海)有限公司 画面调整方法及装置、计算机可读存储介质、终端
CN111246266A (zh) * 2020-03-04 2020-06-05 海信视像科技股份有限公司 一种显示设备及旋转时ui显示方法
CN113867535A (zh) * 2021-10-11 2021-12-31 展讯通信（深圳）有限公司 画面显示方法、装置、终端设备以及存储介质

Also Published As

Publication number Publication date
CN113867535B (zh) 2023-09-05
CN113867535A (zh) 2021-12-31

Similar Documents

Publication Publication Date Title
US20230419570A1 (en) Image Processing Method and Electronic Device
EP4093016A1 (fr) Procédé de traitement d'interpolation de trame et produit associé
WO2021147482A1 (fr) Procédé de photographie au téléobjectif et dispositif électronique
US9036943B1 (en) Cloud-based image improvement
CN111727423A (zh) 包括柔性显示器的电子设备及其控制方法
WO2020063030A1 (fr) Procédé et appareil de réglage de couleur de thème, support d'informations et dispositif électronique
WO2021190348A1 (fr) Procédé de traitement d'image et dispositif électronique
CN112527174B (zh) 一种信息处理方法及电子设备
WO2022105445A1 (fr) Procédé de projection d'écran d'application basé sur un navigateur et appareil associé
US10341557B2 (en) Image processing apparatuses and methods
WO2019200720A1 (fr) Procédé et appareil de compensation de lumière ambiante basés sur un traitement d'image, et dispositif électronique
WO2024031879A1 (fr) Procédé d'affichage de papier peint dynamique et dispositif électronique
WO2023029547A1 (fr) Procédé de traitement vidéo, et dispositif électronique
WO2023231687A1 (fr) Procédé de commutation de caméra et dispositif électronique
CN113536866A (zh) 一种人物追踪显示方法和电子设备
WO2023061325A1 (fr) Procédé et appareil d'affichage d'image, dispositif terminal et support de stockage
CN115669278A (zh) 包括多个相机的电子设备
CN113225616A (zh) 视频播放方法、装置、计算机设备及可读存储介质
CN115643485B (zh) 拍摄的方法和电子设备
US20230377306A1 (en) Video Shooting Method and Electronic Device
US20210360136A1 (en) Apparatus for stabilizing digital image, operating method thereof, and electronic device having the same
CN114827696B (zh) 一种跨设备的音视频数据同步播放的方法和电子设备
CN107888975B (zh) 视频播放方法、装置及存储介质
WO2021052488A1 (fr) Procédé de traitement d'informations et dispositif électronique
EP4262226A1 (fr) Procédé photographique et dispositif associé

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22880264

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE