WO2021169992A1

WO2021169992A1 - Content presentation method and apparatus, terminal device, and computer-readable storage medium

Info

Publication number: WO2021169992A1
Application number: PCT/CN2021/077641
Authority: WO
Inventors: 华文; 徐杰
Original assignee: 华为技术有限公司
Priority date: 2020-02-28
Filing date: 2021-02-24
Publication date: 2021-09-02
Also published as: CN114816617A; CN111338737A; CN111338737B; CN114816617B

Abstract

The present application is applicable to the technical field of terminals, and in particular, to a content presentation method and apparatus, a terminal device, and a computer-readable storage medium. According to the method, during a using process of a current application, a folding operation performed by a user on a folding screen of a terminal device can be received, and a content presentation mode of the current mode can be obtained, so as to quickly start a target mode (i.e., at least one of an AR mode, a VR mode, and a 3D mode) of the current application for content presentation according to the content presentation mode of the current application and the folding operation of the user on the folding screen. The start operation for the AR mode, the VR mode or the 3D mode is simplified, and the start speed of the AR mode, the VR mode or the 3D mode is improved, thereby improving the presentation speed at which content is presented by the application in the AR mode, the VR mode or the 3D mode, and improving the user experience.

Description

Content presentation method, device, terminal equipment and computer readable storage medium

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office on February 28, 2020, the application number is 202010133711.1, and the application name is "content presentation method, device, terminal equipment and computer-readable storage medium", all of which The content is incorporated in this application by reference.

Technical field

This application belongs to the field of terminal technology, and in particular relates to a content presentation method, device, terminal device, and computer-readable storage medium.

Background technique

With the intelligent development of terminal equipment, users can install various applications in the terminal equipment to meet the needs of daily life and work. At present, many applications can use augmented reality AR mode or virtual reality VR mode or three-dimensional 3D mode for content presentation to help users understand content and complete tasks more immersively. However, in existing applications, users need to find a specific button in the application first, and then click the specific button to start the application’s AR mode or VR mode or 3D mode for content presentation, which is relatively inconvenient to operate. AR mode, VR mode or 3D The mode rendering content is slower.

Summary of the invention

The embodiments of the present application provide a content presentation method, device, terminal device, and computer-readable storage medium, which can simply and quickly start the AR mode, VR mode, or 3D mode of the application for content presentation.

In the first aspect, an embodiment of the present application provides a content presentation method, which is applied to a terminal device with a folding screen, and the method may include:

When a folding operation on the folding screen is detected, acquiring a content presentation mode of a current application, where the current application is an application currently being used in the terminal device;

If the content presentation mode is the normal mode, the target mode of the current application is started, and the content of the current application is presented through the target mode. The target modes are augmented reality AR mode, virtual reality VR mode and 3D At least one of the 3D modes.

Exemplarily, the content presentation mode may include a normal mode and an AR mode, that is, the current application may be an application including a normal mode and an AR mode. Alternatively, the content presentation mode may include a normal mode and a VR mode, that is, the current application may be an application including a normal mode and a VR mode. Alternatively, the content acquisition mode may include a normal mode, an AR mode, and a 3D mode, that is, the current application may be an application including a normal mode, an AR mode, and a 3D mode, and so on.

It should be noted that the current application can be a built-in application directly built into the terminal device, that is, an application developed by the manufacturer of the terminal device and directly built into the terminal device, or it can be a terminal device manufacturer and a third-party manufacturer Co-developed and directly built-in applications in terminal equipment, etc.

It should be understood that the current application may also be a third-party application obtained by the terminal device from the outside, that is, the current application may also be developed by a third-party manufacturer, and the terminal device may obtain an application from the third-party manufacturer and install it in the terminal device.

Exemplarily, the terminal device may detect the folding operation performed by the user on the folding screen through one or more of a gravity sensor, an acceleration sensor, and a gyroscope. Exemplarily, the terminal device may also detect the folding operation performed by the user on the folding screen through an angle sensor provided at the bending position of the folding screen. Exemplarily, the terminal device can also detect the folding operation performed by the user on the folding screen through a physical switch set at the bending part of the folding screen. The embodiment of the present application does not specifically limit the detection method of the folding operation.

In some embodiments, when the current application is a third-party application acquired by the terminal device from the outside and installed in the terminal device, the terminal device may be configured with an application interface for docking with the third-party application. Here, the terminal device may send data or instructions to the third-party application and receive data or instructions returned by the third-party application through the configured application interface.

Exemplarily, when the user uses the third-party application, when the terminal device detects that the user folds the folding screen to any angle within the first angle interval, the terminal device can communicate to the third-party application through the configured application interface. The application sends a content presentation mode acquisition instruction, and can receive data about the content presentation mode returned by the third-party application according to the acquisition instruction through the application interface. The terminal device can determine whether the content presentation mode of the third-party application is the normal mode according to the received data. When it is determined that the content presentation mode of the third-party application is the normal mode, the terminal device can send to the third-party application through the application interface the AR mode for starting the third-party application or the VR mode of the third-party application or the third-party application. Start instruction of 3D mode for three-party application. After the third-party application receives the startup instruction transmitted by the application interface, it can start the AR mode, VR mode, or 3D mode of the third-party application according to the startup instruction to pass the AR mode, VR mode, or 3D mode of the third-party application For content presentation.

In other embodiments, when the current application is a third-party application that the terminal device obtains from the outside and is installed in the terminal device, the terminal device may be configured with an application interface for docking with the third-party application. Here, the terminal device may send information such as the folding angle corresponding to the folding operation to the third-party application through the configured application interface, where the folding operation refers to an operation that triggers the third-party application to start AR mode, VR mode, or 3D mode. , The folding angle corresponding to the folding operation refers to the angle between the folded first display screen and the second display screen.

Exemplarily, when the user uses the third-party application, when the terminal device detects that the user folds the folding screen to any angle within the first angle interval, the terminal device can send a message to the third-party application through the configured application interface. The three-party application sends information such as the folding angle corresponding to the folding operation, that is, the included angle between the first display screen and the second display screen can be sent to the third-party application through the configured application interface. After the third-party application receives information such as the folding angle transmitted by the application interface, it can first obtain the content presentation mode of the third-party application, and can determine whether the content presentation mode is a normal mode. When it is determined that the content presentation mode is the normal mode, the third-party application can start the AR mode of the third-party application or start the VR mode of the third-party application or start the 3D mode of the third-party application to pass the third-party application AR mode, VR mode or 3D mode for content presentation.

In some embodiments, when the current application is a third-party application acquired by the terminal device from the outside and installed in the terminal device, the terminal device may be configured with an application interface for docking with the third-party application. Here, the terminal device can send real-time information such as the first angle corresponding to the folding screen to the third-party application through the configured application interface, where the first angle corresponding to the folding screen currently refers to the folding screen in the current form The included angle between the first display screen and the second display screen, the first angle corresponding to the folding screen may be the angle corresponding to the folding operation that can trigger the third-party application to start AR mode, VR mode, or 3D mode, It may also be an angle corresponding to the folding operation that cannot trigger the third-party application to start AR mode, VR mode, or 3D mode.

Exemplarily, when the user uses the third-party application, the terminal device can detect the current first angle and other information corresponding to the folding screen in real time, and can use the configured application interface to display the detected first angle and other information Send to the third-party application in real time. After the third-party application receives the first angle transmitted by the application interface, it can first determine whether the first angle is within the first angle interval. If it is determined that the first angle is within the first angle interval, the third-party application can Obtain the content presentation mode of the third-party application. Then the third-party application can continue to determine whether the content presentation mode is the normal mode. When it is determined that the content presentation mode is the normal mode, the third-party application can start the AR mode of the third-party application or start the VR mode of the third-party application or start the 3D mode of the third-party application to pass the third-party application AR mode, VR mode or 3D mode for content presentation.

In a possible implementation of the first aspect, the folding screen may include a first display screen and a second display screen;

The presenting the content of the current application in the target mode may include:

The first content of the current application is presented in the first display screen in the target mode, and the second content of the current application is presented in the second display screen in the normal mode.

It should be understood that the terminal device may include a rear-mounted first camera device, the first display screen is a folded area in the folding screen, and the second display screen is the folding screen except for the In an area other than the first display screen, the first camera device is disposed at a position corresponding to the first display screen in the terminal device.

It should be noted that the folding screen may include a folded first display screen and an unfolded second display screen. Here, in order to improve the diversity of content presentation in the current application, so as to facilitate users to better understand the content presented in the current application, the terminal device may present the first content of the current application in the target mode on the first display screen, and The second content of the current application can be presented in the normal mode on the second display screen. Specifically, the terminal device can present the first content of the current application on the first display screen in AR mode, and can present the second content of the current application on the second display screen in the normal mode; or the terminal device can display on the first display screen. The first content of the current application can be presented in the VR mode on the screen, and the second content of the current application can be presented in the normal mode on the second display screen; or the terminal device can be presented in the 3D mode on the first display screen. A content, and the second content of the current application can be presented on the second display screen in a normal mode.

It should be understood that the terminal device may include a rear-mounted first camera device, that is, the terminal device may include a rear-mounted camera. When the target mode is the AR mode, the terminal device may collect a real scene image corresponding to the current environment through the first camera device (that is, a rear camera), so as to present content in the AR mode based on the real scene image. Here, in order to ensure the accuracy and effectiveness of the real scene image collection and improve the presentation effect of the content in the AR mode, the first camera device may be located in the folded part of the terminal device. Specifically, the folding screen of the terminal device can form a first display screen and a second display screen after being folded. The first display screen is the folded area of the folding screen, and the second display screen is the folding screen except the first display screen. The area outside, that is, the second display screen is the unfolded area of the folding screen. The position of the first camera device in the terminal device may correspond to the first display screen, that is, the first camera device may be located on the back side of the terminal device corresponding to the first display screen.

Exemplarily, when the target mode is the AR mode, the presenting the first content of the current application in the target mode on the first display screen may include:

Acquire a first real scene image corresponding to the current environment through the first camera device, and determine the indication position and indication of a navigation mark in the first real scene image according to the first real scene image, a preset map, and a preset navigation route direction;

The navigation mark is displayed in the instruction direction at the instruction location, and the first real scene image with the navigation mark is presented on the first display screen.

Exemplarily, when the terminal device determines to start the AR mode of the current application, it can acquire the first real-world image of the user’s current environment through the first camera device, and can compare the acquired first real-world image with the current application. The content of the fusion is merged to merge the content that needs to be presented in the current application into the first real-scene image, and then the merged first real-scene image can be presented on the folding screen of the terminal device.

Specifically, in a navigation scenario, when the user uses the normal mode of the map application (ie 2D navigation mode) for navigation, when the user wants to start the AR mode of the map application (ie, the real-world navigation mode) for navigation, the user can Fold the folding screen of the terminal device to any angle within the first angle interval. When the terminal device detects that the user folds the folding screen to a certain angle within the first angle interval, it can first obtain the first real scene image of the user’s current environment through the first camera device, and then can obtain the first real scene image according to the acquired first real scene The image, the preset map stored in the map application, and the preset navigation route determined by the 2D navigation mode are used to determine the indicated position and direction of the navigation mark in the first real-scene image, where the indicated position may be in the first real-scene image The current real-time location of the user, and the indicated direction may indicate the direction and/or orientation in which the user is walking. Then the navigation mark can be displayed at the indicated position in the first real scene image in the indicated direction, and the first real scene image with the navigation mark can be presented on the folding screen of the terminal device, so as to better help the user to reach through the real scene navigation Destination location. Wherein, the indication direction of the navigation mark in the first real scene image can also be adjusted according to the user's moving direction.

Acquiring a second real scene image corresponding to the current environment through the first camera device, and acquiring a virtual image corresponding to the current application;

The virtual image is fused to the second real scene image, and the second real scene image fused with the virtual image is presented on the first display screen.

Specifically, in the game scene, when the user uses the normal mode of the game application to play the game, when the user wants to start the AR mode of the game application to play the game, the user can fold the folding screen of the terminal device to the first angle interval. Any angle within. When the terminal device detects that the user has folded the folding screen to a certain angle within the first angle interval, it can first obtain the second real-life image of the user’s current environment through the first camera device, and can obtain the current game location in the game application. The corresponding virtual image (such as the foreground image of the game screen, the game object itself, etc.), and then the virtual image and the second real scene image can be merged to merge the virtual image into the second real scene image (for example, the foreground image of the game screen) Fusion into the second real scene image, or fusion of the game object into the second real scene image), and the second real scene image fused with the virtual image can be presented on the folding screen of the terminal device, so that the user can feel the scene in the real environment The experience of playing in the game.

In a possible implementation of the first aspect, the terminal device may further include a front-mounted second camera device, and the second camera device is provided in the terminal device and corresponds to the first display screen. At the location

The method may also include:

The user's interaction gesture is acquired through the second camera device, and the interaction with the current application is performed according to the interaction gesture.

It should be understood that the terminal device may also include a front-mounted second camera device. Here, the terminal device can use the second camera device to perform gesture recognition, and can interact with the current application according to the recognized gesture, so as to improve the interactive performance of the application and enhance the user experience. For example, in order to facilitate the user to interact with the current application through gestures to improve the convenience of gesture interaction, the second camera device can be provided in the folded part of the terminal device, that is, the position of the second camera device in the terminal device can be Corresponding to the first display screen, that is, the second camera device may be located on the front side corresponding to the first display screen in the terminal device. For example, the second camera device may be arranged at a position above the first display screen to improve the convenience of gesture interaction by the user and improve the user experience.

It should be understood that, when a folding operation on the folding screen is detected, acquiring the content presentation mode of the current application may include:

When a folding operation on the folding screen is detected, acquiring the first folding angle corresponding to the folding screen;

If the first folding angle is within the preset first angle interval, acquiring the content presentation mode of the current application.

It should be noted that, in order to avoid false activation of the target mode, the terminal device may store the first angle interval corresponding to the current application, and the first angle interval may be combined to determine whether the user wants to start the target mode of the current application. The first angle interval may be an angle interval preset by the user according to actual conditions, or may be an angle interval set by default by the system in the terminal device, which is not limited in the embodiment of the present application.

Exemplarily, after the presenting the content of the current application in the target mode, the method may include:

Acquiring a second folding angle corresponding to the folding screen;

If the second folding angle is within the preset second angle interval, the target mode is closed, and the content of the current application is presented in the normal mode.

It should be noted that in the process of presenting content in the current application in AR mode, VR mode or 3D mode, the terminal device can also close the AR mode, VR mode or 3D mode of the current application by receiving the user's closing operation to return To the normal mode of the current application. For example, the user can close the AR mode, VR mode, or 3D mode of the current application by restoring the folding screen to its original form. For example, the user can close the AR mode, VR mode, or 3D mode of the current application by restoring the folding screen to the expanded form of the large screen. That is, during the startup process of the AR mode, VR mode, or 3D mode of the current application, the terminal device can obtain the second folding angle corresponding to the folding screen in real time, and determine that the second folding angle is within the preset second angle interval. When the time, the AR mode, VR mode, or 3D mode of the current application can be turned off to present the content of the current application through the normal mode of the current application.

The second angle interval may be an angle interval preset by the user according to actual conditions, or may be an angle interval set by default by the system in the terminal device. For example, the second angle interval may be an angle interval corresponding to the expanded form of the folding screen as a large screen.

Exemplarily, the application interface of the current application may also be provided with a virtual button that closes the AR mode or closes the VR mode or closes the 3D mode. The user can also click or touch the virtual button to close the AR mode of the current application or close the current application VR mode or close the currently applied 3D mode. That is, during the startup process of AR mode, VR mode or 3D mode, the terminal device can detect the triggering state of the virtual button in real time, and when determining that the virtual button is triggered, close the currently applied AR mode, VR mode or 3D mode.

In the second aspect, an embodiment of the present application provides a content presentation device, which is applied to a terminal device with a folding screen, and the device may include:

A mode obtaining module, configured to obtain a content presentation mode of a current application when a folding operation on the folding screen is detected, the current application being an application currently being used in the terminal device;

The content presentation module is configured to, if the content presentation mode is the normal mode, start the target mode of the current application, and present the content of the current application through the target mode, the target mode being an augmented reality AR mode, At least one of a virtual reality VR mode and a three-dimensional 3D mode.

In a possible implementation of the second aspect, the folding screen may include a first display screen and a second display screen;

The content presentation module is further configured to present the first content of the current application in the target mode on the first display screen, and present the current application in the normal mode on the second display screen. The second content of the application.

Exemplarily, the content presentation module may include:

The first real scene image acquisition unit is configured to acquire a first real scene image corresponding to the current environment through the first camera device, and determine that a navigation mark is in the first real scene image, a preset map, and a preset navigation route. 1. The indicating position and direction in the real image;

The first content presentation unit is configured to display the navigation mark in the instruction direction at the instruction location, and present the first real scene image with the navigation mark on the first display screen.

Exemplarily, the content presentation module may further include:

A second real-scene image acquiring unit, configured to acquire a second real-scene image corresponding to the current environment through the first camera device, and to acquire a virtual image corresponding to the current application;

The second content presentation unit is configured to fuse the virtual image to the second real scene image, and present the second real scene image fused with the virtual image on the first display screen.

In a possible implementation of the second aspect, the terminal device may further include a front-mounted second camera device, and the second camera device is provided in the terminal device and corresponds to the first display screen. At the location

The device may also include:

The gesture interaction module is used to obtain the user's interaction gesture through the second camera device, and interact with the current application according to the interaction gesture.

It should be understood that the pattern acquisition module may include:

The first folding angle acquiring unit is configured to acquire the first folding angle corresponding to the folding screen when a folding operation on the folding screen is detected;

The mode obtaining unit is configured to obtain the content presentation mode of the current application if the first folding angle is within a preset first angle interval.

Exemplarily, the device may further include:

The second folding angle obtaining module is configured to obtain the second folding angle corresponding to the folding screen;

The target mode closing module is configured to close the target mode if the second folding angle is within a preset second angle interval, and present the content of the current application in the normal mode.

In the third aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the computer program, The content presentation method according to any one of the above-mentioned first aspects is implemented.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the implementation is as described in any one of the above-mentioned first aspects. The content presentation method described.

In a fifth aspect, the embodiments of the present application provide a computer program product, which when the computer program product runs on a terminal device, causes the terminal device to execute the content presentation method described in any one of the above-mentioned first aspects.

It is understandable that, for the beneficial effects of the second aspect to the fifth aspect described above, reference may be made to the relevant description in the first aspect described above, and details are not repeated here.

Compared with the prior art, the embodiments of this application have the following beneficial effects:

In the embodiments of the present application, during the use of the current application, when the user wants to start the target mode of the current application (that is, at least one of AR mode, VR mode, and 3D mode) for content presentation, the user can display content to the terminal The folding screen of the device is folded. At this time, the terminal device can obtain the content presentation mode of the current application, and can quickly start the AR mode, VR mode, or 3D mode of the current application based on the content presentation mode of the current application and the user's folding operation on the folding screen to perform content presentation. Simplify the startup operation of AR mode, VR mode or 3D mode, improve the startup speed of AR mode, VR mode or 3D mode, thereby increasing the presentation speed of content presentation through AR mode, VR mode or 3D mode, and improve users Experience.

Description of the drawings

Figure 1 is a schematic diagram of AR mode activation in the prior art;

FIG. 2 is a schematic flowchart of a content presentation method provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of the folding angle corresponding to the folding screen;

Figure 4a is a schematic diagram of a scene of content presentation in VR mode;

Figure 4b is a schematic diagram of a scene of content presentation in 3D mode;

Figure 5 is a schematic diagram of an application scenario provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of an application scenario provided by another embodiment of the present application;

FIG. 7 is a schematic diagram of an application scenario provided by an embodiment of the present application;

FIG. 8 is an example diagram of an application scenario provided by another embodiment of the present application;

FIG. 9 is a schematic structural diagram of a content presentation device provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of a terminal device provided by an embodiment of the present application;

FIG. 11 is a schematic structural diagram of a mobile phone to which the content presentation method provided by an embodiment of the present application is applicable;

FIG. 12 is a schematic diagram of a software architecture to which the content presentation method provided by an embodiment of the present application is applicable.

Detailed ways

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are proposed for a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of this application.

It should be understood that when used in the specification and appended claims of this application, the term "comprising" indicates the existence of the described features, wholes, steps, operations, elements and/or components, but does not exclude one or more other The existence or addition of features, wholes, steps, operations, elements, components, and/or collections thereof.

It should also be understood that the term "and/or" used in the specification and appended claims of this application refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

As used in the description of this application and the appended claims, the term "if" can be construed as "when" or "once" or "in response to determination" or "in response to detecting ". Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted as meaning "once determined" or "in response to determination" or "once detected [described condition or event]" depending on the context ]" or "in response to detection of [condition or event described]".

In addition, in the description of the specification of this application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.

Reference to "one embodiment" or "some embodiments" described in the specification of this application means that one or more embodiments of this application include a specific feature, structure, or characteristic described in combination with the embodiment. Therefore, the sentences "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless it is specifically emphasized otherwise. The terms "including", "including", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

The content presentation method provided by the embodiments of this application can be applied to mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR)/virtual reality (VR) devices, notebook computers, and super mobile personal computers For terminal devices (ultra-mobile personal computer, UMPC), netbooks, and personal digital assistants (personal digital assistant, PDA), the embodiments of this application do not impose any restrictions on the specific types of terminal devices.

At present, many applications can use augmented reality AR technology, virtual reality VR technology or three-dimensional 3D technology for content presentation to help users understand content and complete tasks more immersively. In other words, many applications can be set with normal mode (ie normal 2D mode), AR mode based on AR technology, VR mode based on VR technology, and 3D mode based on 3D technology for users to choose content presentation mode. , So that the content in the application can be presented according to the content presentation mode selected by the user. However, in existing applications, users often need to find the specific button corresponding to the AR mode, VR mode, or 3D mode in the application, and then click or touch the specific button to start the AR mode, VR mode, or 3D mode of the application. Content presentation through AR mode, VR mode or 3D mode. As shown in Figure 1, when the user uses the normal mode of the map application (ie 2D navigation mode) to present the navigation content, if the user wants to present the navigation content through the AR mode (ie the real-world navigation mode), the user needs to first Find the specific button corresponding to the real-scene navigation mode in the map application (for example, you need to find the AR button in Figure 1 first), and then click or touch the AR button to enter the real-scene navigation mode, so that you can use the real-scene navigation mode to perform real-scene navigation content Present. This way of starting AR mode, VR mode or 3D mode by clicking or touching a specific button is easy to cause cumbersome and inconvenient operation, and for those applications where specific button settings are more concealed, this cumbersome and inconvenient operation is particularly obvious , Making the start-up speed of AR mode, VR mode or 3D mode slower, so that the presentation speed of content presentation by the application through AR mode, VR mode or 3D mode is slower, which affects user experience.

In order to solve the foregoing problems, embodiments of the present application provide a content presentation method, device, terminal device, and computer-readable storage medium. The terminal device to which the content presentation method is applied may be a terminal device with a folding screen. During the user's use of an application on the terminal device, when the user wants to start the target mode of the application (that is, at least one of AR mode, VR mode, and 3D mode) for content presentation, the user can display the content of the terminal device. The folding screen is folded. At this time, the terminal device can obtain the content presentation mode of the application, and can quickly start the AR mode, VR mode, or 3D mode of the application for content presentation based on the content presentation mode of the application and the user's folding operation on the folding screen. Simplify the startup operation of AR mode, VR mode or 3D mode, and improve the startup speed of AR mode, VR mode or 3D mode, thereby improving the presentation speed of content presentation of applications through AR mode, VR mode or 3D mode, and improving user experience .

It should be noted that the folding screen of the terminal device to which the content presentation method provided in the embodiment of the present application is applied may adopt an integrated flexible display screen, or may adopt two rigid screens and a flexible screen located between the two rigid screens. Screen composed of display screens. During use, the folding screen can be switched between the small screen in the folded form and the large screen in the expanded form at any time. Among them, the folding form can be completely folded, that is, the angle between the first display screen and the second display screen corresponding to the folding screen after being folded is 0 degrees (in fact, it may not reach 0 degrees, which is specified in the terminal device. The angle sensor and other sensors actually report the angle), or it can be partially folded, that is, the angle between the first display and the second display after the folding screen is folded is greater than 0 degrees and less than 180 degrees.

Fig. 2 shows a schematic flowchart of a content presentation method provided by an embodiment of the present application. As shown in Figure 2, the content presentation method may include:

S201: When a folding operation on the folding screen is detected, obtain a content presentation mode of a current application, where the current application is an application currently being used in the terminal device.

It should be understood that the current application is an application currently being used by the user in the terminal device, that is, the current application is an application running in the foreground in the terminal device. Wherein, the content presentation mode may include a normal mode, and may include at least one of an AR mode, a VR mode, and a 3D mode.

Exemplarily, the content presentation mode may include a normal mode and an AR mode, that is, the current application may be an application including a normal mode and an AR mode. For example, the current application can be a map application containing a normal mode (ie 2D navigation mode) and an AR mode (ie a real-world navigation mode), or it can be a map application containing a normal mode (ie a normal 2D game mode) and an AR mode (ie a fusion of real scenes). Game mode) game application. Exemplarily, the content presentation mode may include a normal mode and a VR mode, that is, the current application may be an application including a normal mode and a VR mode. For example, the current application may be a house rental application including a normal mode and a VR mode, or may be a commodity display (sale) application including a normal mode and a VR mode. Exemplarily, the content acquisition mode may also include a normal mode, an AR mode, and a 3D mode, that is, the current application may be an application including a normal mode, an AR mode, and a 3D mode, and so on.

It should be noted that the current application can be a built-in application directly built into the terminal device, that is, an application developed by the manufacturer of the terminal device and directly built into the terminal device, or it can be a terminal device manufacturer and a third-party manufacturer Co-developed and directly built-in applications in terminal equipment, etc. For example, the current application may be a game application developed by the manufacturer of the terminal device and built into the terminal device. For example, the current application may be a map application developed in cooperation with a third-party manufacturer and built into the terminal device by the manufacturer of the terminal device.

It should be understood that the current application may also be a third-party application obtained by the terminal device from the outside, that is, the current application may also be developed by a third-party manufacturer, and the terminal device may obtain an application from the third-party manufacturer and install it in the terminal device. For example, the current application may also be a map application downloaded and installed by the terminal device from a third-party manufacturer.

Specifically, when a user uses a certain application of the terminal device (that is, the current application described above), when the user wants to start the target mode of the current application (that is, at least one of AR mode, VR mode, and 3D mode) Mode) for content presentation, as shown in Figure 1, when the user uses the map application in the terminal device to navigate, when the user wants to start the AR mode of the map application (that is, the real-scene navigation mode) to present the navigation content The user can fold the folding screen of the terminal device, and the terminal device can obtain the content presentation mode of the map application according to the user's folding operation on the folding screen, and can start the AR mode according to the content presentation mode of the map application.

Exemplarily, the terminal device may detect the folding operation performed by the user on the folding screen through one or more of a gravity sensor, an acceleration sensor, and a gyroscope. Exemplarily, the terminal device may also detect the folding operation performed by the user on the folding screen through an angle sensor provided at the bending position of the folding screen. Specifically, the angle sensor can measure the included angle between the two ends of the bending part in the middle of the folding screen in real time (that is, measure the included angle between the first display screen and the second display screen in real time), when the included angle is less than or equal to the preset When angled, the terminal device can detect the folding operation performed by the user on the folding screen through the angle sensor. The preset angle can be specifically set according to actual conditions, which is not specifically limited in the embodiment of the present application.

In some embodiments, the terminal device may also detect the folding operation performed by the user on the folding screen through a physical switch provided at the bending part of the folding screen. For example, when the user performs a folding operation on the folding screen, the physical switch set on the terminal device will be triggered to open, and the terminal device can detect the folding operation performed by the user on the folding screen according to the opening of the physical switch.

It should be understood that the detection of the folding operation performed by the user on the folding screen through the gravity sensor, acceleration sensor, gyroscope, angle sensor, and physical switch in the above example is only used to explain the embodiment of the present application, and should not constitute a specific example of the embodiment of the present application. limited.

Here, a unified first angle interval may be set in the terminal device for different applications, or different first angle intervals may be set for different applications, which is not limited in the embodiment of the present application. For example, the terminal device may be provided with a unified first angle interval [50°, 70°] for application A and application B containing the AR mode and application C containing the VR mode. For example, the first angle interval [50°, 70°] may be set in the terminal device for application A and application B containing the AR mode, and the first angle interval [60°, 80°] may be set for the application C containing the VR mode. ]. For example, in the terminal device, the first angle interval [50°, 70°] may be set for the application A containing the AR mode, and the first angle interval [60°, 80°] may be set for the application B containing the AR mode. A first angle interval [80°, 90°] is set for the application C including the VR mode.

Exemplarily, when the terminal device detects the folding operation performed by the user on the folding screen, it can obtain the first folding angle corresponding to the folding screen, and can determine whether the user wants to start according to the first folding angle and the first angle interval. The target mode of the current application. Specifically, when the first folding angle is within the first angle interval, the terminal device can determine the target mode in which the user wants to start the current application. At this time, the terminal device can obtain the content presentation mode of the current application to determine the content presentation mode of the current application. Content presentation mode to start the target mode.

It should be noted that the folding operation can be an operation of folding the folding screen toward the direction facing the first display screen and the second display screen, or the folding screen facing the first display screen and the second display screen. The folding operation of the display screen in opposite directions is not limited in the embodiment of the present application. For ease of understanding, the following embodiments of the present application will exemplify an example in which the folding operation is an operation in which the folding screen is folded in a direction facing the first display screen and the second display screen.

As shown in FIG. 3, the first folding angle corresponding to the folding screen refers to the difference between the first display screen (that is, the B screen shown in FIG. 3) and the second display screen (that is, the A screen shown in FIG. 3) corresponding to the folding screen. The angle between α. Exemplarily, the terminal device may obtain the first folding angle corresponding to the folding screen through one or more of a gravity sensor, an acceleration sensor, and a gyroscope. Exemplarily, the terminal device may also obtain the first folding angle corresponding to the folding screen through an angle sensor provided at the bending position of the folding screen.

For example, in a scene where the first angle interval is [50°, 70°], after the user performs a folding operation on the folding screen, the terminal device can obtain the first folding angle corresponding to the folding screen through the angle sensor, that is, through the angle The sensor measures the angle between the first display screen and the second display screen corresponding to the folding screen, and when the first folding angle acquired by the terminal device is 60°, the terminal device can determine the target that the user currently wants to launch the current application. Mode, at this time, the terminal device can obtain the content presentation mode of the current application in the terminal device to start the target mode of the current application according to the content presentation mode of the current application.

S202. If the content presentation mode is the normal mode, start the target mode of the current application, and present the content of the current application through the target mode, the target mode being an augmented reality AR mode or a virtual reality VR mode And at least one of three-dimensional 3D mode.

It should be understood that the target mode may be any one of AR mode, VR mode and 3D mode, or any two or three modes among AR mode, VR mode and 3D mode. For example, when the user wants to view the installation effect of item A in actual environment B, the user can start the AR mode and 3D mode of application C (an application that can simulate the installation effect) in actual environment B, so as to pass the item A Simulate the display in the actual environment B in 3D mode to view the installation effect of the item A in the actual environment B.

Here, whether the target mode is any one of AR mode, VR mode, and 3D mode, or any two or three modes among AR mode, VR mode, and 3D mode, can be specifically determined according to actual conditions. Exemplarily, when the current application only supports normal mode and AR mode, the target mode is AR mode; when the current application only supports normal mode and 3D mode, the target mode is 3D mode; when the current application supports normal mode, AR In mode, VR mode and 3D mode, the target mode can be customized by the user in advance (for example, the target mode can be customized as a combination of AR mode and 3D mode), or it can be set by default by the terminal device system (for example, you can set The target mode is set to the AR mode by default), and it can also be automatically determined by the terminal device according to the actual scene (for example, the target mode can be automatically determined as the VR mode according to the actual scene), which is not specifically limited in the embodiment of the present application. For ease of understanding, the following embodiments of the present application will take any one of the AR mode, VR mode, and 3D mode as an example for exemplification.

It should be understood that when the content presentation mode of the current application has been AR mode, VR mode or 3D mode, the terminal device can maintain the AR mode, VR mode or 3D mode of the current application, that is, it can continue to pass through on the folded folding screen. AR mode, VR mode or 3D mode to present the content of the current application. When the content presentation mode of the current application is the normal mode, the terminal device can start the AR mode of the current application or the VR mode of the current application or the 3D mode of the current application to pass AR mode, VR mode or 3D mode to present the content of the current application.

It should be noted that the terminal device may include a rear-mounted first camera device, that is, the terminal device may include a rear-mounted camera. When the target mode is the AR mode, the terminal device may collect a real scene image corresponding to the current environment through the first camera device (that is, a rear camera), so as to present content in the AR mode based on the real scene image. Here, in order to ensure the accuracy and effectiveness of the real scene image collection and improve the presentation effect of the content in the AR mode, the first camera device may be located in the folded part of the terminal device. Specifically, the folding screen of the terminal device can form a first display screen and a second display screen after being folded. The first display screen is the folded area of the folding screen, and the second display screen is the folding screen except the first display screen. The area outside, that is, the second display screen is the unfolded area of the folding screen. The position of the first camera device in the terminal device may correspond to the first display screen, that is, the first camera device may be located on the back side of the terminal device corresponding to the first display screen.

Specifically, in the navigation scenario, when the user wants to start the AR mode of the map application (ie, the real-scene navigation mode) for navigation, the user can Fold the folding screen of the terminal device to any angle within the first angle interval. When the terminal device detects that the user folds the folding screen to a certain angle within the first angle interval, it can first acquire the first real scene image of the user’s current environment through the first camera device, and then can use the acquired first real scene The image, the preset map stored in the map application, and the preset navigation route determined by the 2D navigation mode are used to determine the indicated position and direction of the navigation mark in the first real-scene image, where the indicated position may be in the first real-scene image The real-time location where the user is currently located, and the indication direction may be the direction and/or orientation in which the user is walking. Then, the navigation mark can be displayed in the indicated position in the first real scene image in the indicated direction, and the first real scene image with the navigation mark can be presented on the folding screen of the terminal device, so as to better help the user to reach through the real scene navigation Destination location. Wherein, the indication direction of the navigation mark in the first real scene image can also be adjusted according to the user's moving direction.

Exemplarily, the terminal device may also determine the indicated position and direction of the navigation marker in the first real-scene image according to the acquired first real-scene image, the preset map stored in the map application, and the destination location to be reached by the user. Specifically, the terminal device can first determine the user's current location in the first real-life image (that is, the above-mentioned indicated location) according to the first real-life image and the preset map, and then can determine the user's current location based on the user's current location and the destination that the user wants to reach. The location plans the user's real-scene navigation route, and the navigation identifier can be presented in the first real-scene image according to the real-scene navigation route.

In the above example, "determine the indicated position and direction of the navigation mark in the first real image according to the acquired first real image, the preset map stored in the map application, and the preset navigation route determined by the 2D navigation mode" , And “determine the indication position and direction of the navigation mark in the first real scene image according to the acquired first real scene image, the preset map stored in the map application, and the destination position that the user wants to reach” is only used to explain this The application example should not constitute a limitation to the example of the application. Of course, the example of the application may be used to determine the indication position and direction of the navigation indicator in the live navigation mode through any existing determination method.

Specifically, in the translation scenario, when the user wants to start the AR mode of the translation application for translation, the user can fold the folding screen of the terminal device to the first angle interval when the user wants to start the AR mode of the translation application during the translation process in the normal mode of the translation application. Any angle within. When the terminal device detects that the user folds the folding screen to a certain angle within the first angle interval, it can first acquire the third real scene image containing the content to be translated through the first camera device, and can compare the third real scene image in the third real scene image. The content to be translated is translated to obtain the target translation content corresponding to the content to be translated, and then the target translation content can be merged into the third real scene image (for example, the target translation content can be merged to the position of the content to be translated in the third real scene image , To replace the content to be translated in the third real scene image), and the third real scene image integrated with the target translation content can be presented on the folding screen of the terminal device.

Specifically, in the photo scene, when the user wants to start the AR mode of the camera to take a photo during the user's normal mode of the camera, the user can fold the folding screen of the terminal device to the first angle interval. Any angle. When the terminal device detects that the user has folded the folding screen to a certain angle within the first angle interval, it can first obtain the fourth real scene image that the user needs to take through the first camera device, and can obtain the virtual image corresponding to the AR mode. Then, the virtual object and the fourth real-life image can be fused and presented on the folding screen of the terminal device, so that after the user performs the photographing operation, a photographed image fused with the virtual object can be obtained to meet the different photographing needs of the user and improve The fun of shooting enhances the user experience. Among them, the virtual object can be an object selected by the user, or an object selected by the terminal device by default when the AR mode is activated, or an object automatically matched by the terminal device according to the current environment corresponding to the third real-life image. This application The embodiment does not specifically limit this.

It should be understood that the terminal device may also include a front-facing second camera device, such as a front-facing camera. Here, the terminal device can use the second camera device to perform gesture recognition, and can interact with the current application according to the recognized gesture, so as to improve the interactive performance of the application and enhance the user experience. For example, in order to facilitate the user to interact with the current application through gestures to improve the convenience of gesture interaction, the second camera device can be provided in the folded part of the terminal device, that is, the position of the second camera device in the terminal device can be Corresponding to the first display screen, that is, the second camera device may be located on the front side corresponding to the first display screen in the terminal device. For example, the second camera device may be arranged at a position above the first display screen to improve the convenience of gesture interaction by the user and improve the user experience.

For example, in a game scenario, when the user is playing the game through the AR mode of the game application, the user can also perform corresponding interactive gestures, and the terminal device can acquire the user's interactive gestures through the second camera on the front, and According to the acquired interactive gestures, interact with game objects in the game application, etc., to unlock more game play methods and enhance the user's game experience.

Exemplarily, when determining to start the VR mode or 3D mode of the current application, the terminal device may first obtain the content currently being presented in the current application, and may search for the VR content or 3D content corresponding to the content currently being presented, and then The found VR content or 3D content can be presented on the folding screen to present the content of the current application in the VR mode or 3D mode.

For example, in the item display scene, when the user uses the normal mode of the rental and sales application to view the house plan, when the user wants to start the VR mode of the rental and sales application to view the house, the user can turn the folding screen of the terminal device Fold to any angle in the first angle interval. When the terminal device detects that the user has folded the folding screen to a certain angle within the first angle interval, it can first obtain the content currently being presented in the rental and sale application (that is, the floor plan of the house currently being viewed by the user), and can search The VR image corresponding to the floor plan of the house (that is, the real view of the house) can then be presented on the folding screen of the terminal device to display the real view of the house found to obtain the rendering effect image shown in FIG. 4a.

For example, in the item display scene, when the user wants to start the 3D mode of the item browsing application to view the item, the user can fold the folding screen of the terminal device to Any angle in the first angle interval. When the terminal device detects that the user has folded the folding screen to a certain angle within the first angle interval, it can first obtain the content of the item currently being presented in the item browsing application (ie, the item plan), and can search for the item corresponding to the item plan. The 3D image can then be displayed on the folding screen of the terminal device, so as to obtain the rendering effect image shown in FIG. 4b.

In a possible implementation, when the current application is a built-in application directly built into the terminal device, the built-in application can be directly operated and controlled by the terminal device, that is, the terminal device can directly perform the operation and control according to the detected folding operation. Perform corresponding operations and control on the built-in applications built in the terminal device. In other words, when the user uses the built-in application built in the terminal device, when the user folds the folding screen of the terminal device to any angle within the first angle interval, the terminal device can directly obtain the information of the built-in application. Content presentation mode, and can determine whether the content presentation mode of the built-in application is the normal mode. When it is determined that the content presentation mode of the built-in application is the normal mode, the terminal device can directly start the AR mode of the built-in application, or can directly start the VR mode of the built-in application, or can directly start the 3D mode of the built-in application to The content is presented through the AR mode, VR mode or 3D mode of the built-in application.

In another possible implementation manner, when the current application is a third-party application obtained by the terminal device from the outside and installed in the terminal device, the terminal device may be configured with an application interface for docking with the third-party application. Here, the terminal device may send data or instructions to the third-party application and receive data or instructions returned by the third-party application through the configured application interface.

Exemplarily, when the user uses the third-party application, when the terminal device detects that the user folds the folding screen to any angle within the first angle interval, the terminal device can communicate to the third-party application through the configured application interface. The application sends a content presentation mode acquisition instruction, and can receive data about the content presentation mode returned by the third-party application according to the acquisition instruction through the application interface. The terminal device can determine whether the content presentation mode of the third-party application is the normal mode according to the received data. When it is determined that the content presentation mode of the third-party application is the normal mode, the terminal device can send to the third-party application through the application interface the AR mode that starts the third-party application or the VR mode of the third-party application or the third-party application is started. Start instruction of the 3D mode of the third-party application. After the third-party application receives the startup instruction transmitted by the application interface, it can start the AR mode, VR mode, or 3D mode of the third-party application according to the startup instruction to pass the AR mode, VR mode, or 3D mode of the third-party application For content presentation.

In a possible implementation manner, when the current application is a third-party application acquired by the terminal device from the outside and installed in the terminal device, the terminal device may be configured with an application interface for docking with the third-party application. Here, the terminal device may send information such as the folding angle corresponding to the folding operation to the third-party application through the configured application interface, where the folding operation refers to an operation that triggers the third-party application to start AR mode, VR mode, or 3D mode. , The folding angle corresponding to the folding operation refers to the angle between the folded first display screen and the second display screen.

In another possible implementation manner, when the current application is a third-party application obtained by the terminal device from the outside and installed in the terminal device, the terminal device may be configured with an application interface for docking with the third-party application. Here, the terminal device can send real-time information such as the first angle corresponding to the folding screen to the third-party application through the configured application interface, where the first angle corresponding to the folding screen currently refers to the folding screen in the current form The included angle between the first display screen and the second display screen, the first angle corresponding to the folding screen may be the angle corresponding to the folding operation that can trigger the third-party application to start AR mode, VR mode, or 3D mode, It may also be an angle corresponding to the folding operation that cannot trigger the third-party application to start AR mode, VR mode, or 3D mode.

As can be seen from the foregoing description, the folding screen may include a folded first display screen and an unfolded second display screen. Here, in order to improve the diversity of content presentation in the current application, so as to facilitate users to better understand the content presented in the current application, the terminal device may present the first content of the current application in the target mode on the first display screen, and The second content of the current application can be presented in the normal mode on the second display screen. Specifically, the terminal device can present the first content of the current application on the first display screen in AR mode, and can present the second content of the current application on the second display screen in the normal mode; or the terminal device can display on the first display screen. The first content of the current application can be presented in the VR mode on the screen, and the second content of the current application can be presented in the normal mode on the second display screen; or the terminal device can be presented in the 3D mode on the first display screen. A content, and the second content of the current application can be presented on the second display screen in a normal mode.

For example, as shown in FIG. 5, in a navigation scene, the terminal device can present real-world navigation content in the AR mode (ie, real-scene navigation mode) on the first display screen, and can present 2D navigation in the normal mode on the second display screen. content. That is, when the user uses the normal mode of the map application for navigation, when the user wants to start the AR mode in the map application for navigation, the user can fold the folding screen of the terminal device to any angle within the first angle interval. When the terminal device detects that the user folds the folding screen to a certain angle within the first angle interval, it can acquire the first real scene image of the user’s current environment through the first camera device, and can use the real scene image based on the first real scene image. The navigation content is presented on the first display screen of the terminal device. At the same time, the terminal device can also present the original 2D navigation content in a normal mode on the second display screen of the terminal device. Among them, the real-time navigation content presented on the first display screen and the 2D navigation content presented on the second display screen can be adjusted in real time according to the user's movement. The adjustment of the indication direction corresponding to the navigation mark, etc.

For example, as shown in FIG. 6, in a game scene, the terminal device can present a game screen integrated with the real scene in the AR mode on the first display screen, and can perform game operations and/or display in the normal mode on the second display screen. Or control virtual function buttons and/or game props. That is, when the user uses the normal mode of the game application to play the game, when the user wants to start the AR mode of the game application to play the game, the user can fold the folding screen of the terminal device to any angle within the first angle interval. When the terminal device detects that the user has folded the folding screen to a certain angle within the first angle interval, it can obtain the second real scene image of the user’s current environment through the first camera device, and obtain the current game corresponding to the game in the game application. A virtual image (that is, a game foreground image or game object that does not include virtual function buttons and game props), and a second real-scene image integrated with the game foreground image or game object can be presented on the first display screen of the terminal device. At the same time, the terminal device can also present content such as virtual function keys and/or game props for game operation and/or control on the second display screen of the terminal device in a normal mode.

For example, in a translation scenario, the terminal device may present the third real-world image fused with the target translation content in the AR mode on the first display screen, and may present the content to be translated in the normal mode on the second display screen. That is, when the user performs translation in the normal mode of the translation application, when the user wants to start the AR mode of the translation application for translation, the user can fold the folding screen of the terminal device to any angle within the first angle interval. When the terminal device detects that the user folds the folding screen to a certain angle within the first angle interval, it can first acquire the third real scene image containing the content to be translated through the first camera device, and can compare the third real scene image in the third real scene image. The content to be translated is translated, and then the target translation content obtained by the translation can be merged into the third real scene image, and the third real scene image fused with the target translation content can be presented on the first display screen of the terminal device. At the same time, the terminal device can also present the content to be translated on the third display screen of the terminal device in a normal mode.

For example, in a photographing scene, the terminal device may present a fourth real-life image fused with virtual objects in the AR mode on the first display screen, and may present the preview image during the photographing process in the normal mode on the second display screen (i.e. Does not contain images of virtual objects). That is, when the user uses the normal mode of the camera to take pictures, when the user wants to activate the AR mode of the camera to take pictures, the user can fold the folding screen of the terminal device to any angle within the first angle interval. When the terminal device detects that the user has folded the folding screen to a certain angle within the first angle interval, it can first obtain the fourth real scene image that the user needs to take through the first camera device, and can obtain the virtual image corresponding to the AR mode. Then, the virtual object and the fourth real-life image can be merged and presented on the first display screen of the terminal device. At the same time, the terminal device can also present the preview image without virtual objects obtained during the photographing process on the second display screen of the terminal device.

For example, as shown in Figure 7, in a house rental and sale scenario, the terminal device can present a VR picture of the house (ie a real-life picture of the house) in the VR mode on the first display screen, and can use the normal mode on the second display screen. Present the floor plan of the house. That is, when the user uses the normal mode of the rental and sales application to view the house plan, when the user wants to start the VR mode of the rental and sales application to view the house, the user can fold the folding screen of the terminal device to the first angle interval Any angle. When the terminal device detects that the user folds the folding screen to a certain angle within the first angle interval, it can first obtain the house plan currently being presented in the rental and sale application, and can find the real house picture corresponding to the house plan , And then the real view of the house can be presented on the first display screen of the terminal device. At the same time, the terminal device can also present the original house plan in a normal mode on the second display screen of the terminal device. Here, in the process of presenting the real view of the house, the user can browse the real view of the house by sliding the first display screen. At this time, the floor plan of the house in the second display screen can also be rotated with the user's viewing angle, making the user more Immersively use the VR viewing function to understand the characteristics of the house.

For example, as shown in FIG. 8, in an item display scene, the terminal device may present a 3D image of the item in a 3D mode on the first display screen, and may present a plan view of the item in a normal mode on the second display screen. That is to say, when the user wants to start the 3D mode of the item browsing application to view the 3D items in the process of viewing the item plan in the normal mode of the item browsing application, the user can fold the folding screen of the terminal device to the first angle interval. Any angle. When the terminal device detects that the user has folded the folding screen to a certain angle within the first angle interval, it can first obtain the item plan view currently being presented in the item browsing application, and can search for the 3D image corresponding to the item plan view, and then The 3D image can be presented on the first display screen of the terminal device. At the same time, the terminal device can also present the original item plan view on the second display screen of the terminal device in a normal mode.

For example, in a navigation scenario, when the terminal device determines that the user restores the folding screen to the expanded form of the large screen, the AR mode of the map application can be turned off, and the 2D navigation content of the map application can be presented in the normal mode. For example, in a game scenario, when the terminal device determines that the user restores the folding screen to the expanded form of the large screen, the AR mode of the game application can be closed, and the game screen, virtual function buttons, and game props can be adjusted through the normal mode. To present. For example, in the house rental and sale scenario, when the terminal device determines that the user restores the folding screen to the expanded form of the large screen, the VR mode of the house rental and sale application can be closed, and the house floor plan can be presented in the normal mode, etc. Wait.

Exemplarily, the application interface of the current application may also be provided with a virtual button that closes the AR mode or closes the VR mode or closes the 3D mode. The user can also click or touch the virtual button to close the AR mode of the current application or close the current application VR mode or close the currently applied 3D mode. That is, during the startup process of AR mode, VR mode or 3D mode, the terminal device can detect the trigger state of the virtual button in real time, and when it is determined that the virtual button is triggered, it can turn off the currently applied AR mode, VR mode or 3D mode. model.

In the embodiments of the present application, during the use of the current application, when the user wants to start the target mode of the current application (that is, at least one of AR mode, VR mode, and 3D mode) for content presentation, the user can The folding screen of the terminal device is folded. At this time, the terminal device can obtain the content presentation mode of the current application, and can quickly start the target mode of the current application based on the content presentation mode of the current application and the folding operation performed by the user on the folding screen to perform content presentation, simplifying the AR mode, The startup operation of VR mode or 3D mode improves the startup speed of AR mode, VR mode or 3D mode, thereby increasing the presentation speed of content presentation by applications in AR mode, VR mode or 3D mode, and improving user experience.

It should be understood that the size of the sequence number of each step in the foregoing embodiment does not mean the order of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

Corresponding to the content presentation method described in the above embodiment, FIG. 9 shows a structural block diagram of a content presentation device provided in an embodiment of the present application. For ease of description, only the parts related to the embodiment of the present application are shown.

Referring to FIG. 9, the content presentation apparatus is applied to a terminal device with a folding screen, and the apparatus may include:

The mode obtaining module 901 is configured to obtain the content presentation mode of the current application when a folding operation on the folding screen is detected, the current application being an application currently being used in the terminal device;

The content presentation module 902 is configured to start the target mode of the current application if the content presentation mode is the normal mode, and present the content of the current application through the target mode, the target mode being an augmented reality AR mode , At least one of virtual reality VR mode and three-dimensional 3D mode.

In a possible implementation, the folding screen may include a first display screen and a second display screen;

The content presentation module 902 is further configured to present the first content of the current application in the target mode on the first display screen, and present the first content of the current application in the normal mode on the second display screen. The second content of the current application.

Exemplarily, the content presentation module 902 may include:

Exemplarily, the content presentation module 902 may further include:

A second real-scene image acquisition unit, configured to acquire a second real-scene image corresponding to the current environment through the first camera device, and acquire a virtual image of the current application;

In a possible implementation manner, the terminal device may further include a front-mounted second camera device, and the second camera device is provided at a position corresponding to the first display screen in the terminal device;

The device may also include:

It should be understood that the mode acquisition module 901 may include:

Exemplarily, the device may further include:

It should be noted that the information interaction and execution process between the above-mentioned devices/units are based on the same concept as the method embodiment of this application, and its specific functions and technical effects can be found in the method embodiment section. I won't repeat it here.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the division of the above functional units and modules is used as an example. In practical applications, the above functions can be allocated to different functional units and modules as needed. Module completion, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist alone physically, or two or more units can be integrated into one unit. The above-mentioned integrated units can be hardware-based Formal realization can also be realized in the form of a software functional unit. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of this application. For the specific working process of the units and modules in the foregoing system, reference may be made to the corresponding process in the foregoing method embodiment, which will not be repeated here.

FIG. 10 is a schematic structural diagram of a terminal device provided by an embodiment of this application. As shown in FIG. 10, the terminal device 10 of this embodiment includes: at least one processor 1000 (only one is shown in FIG. 10), a memory 1001, and stored in the memory 1001 and can be stored in the at least one processor 1000. When the processor 1000 executes the computer program 1002, the steps in any of the foregoing content presentation method embodiments are implemented.

The terminal device 10 may include, but is not limited to, a processor 1000 and a memory 1001. Those skilled in the art can understand that FIG. 10 is only an example of the terminal device 10, and does not constitute a limitation on the terminal device 10. The terminal device 10 may include more or less components than those shown in the figure, or a combination of certain components, or Different components, for example, may also include input and output devices, network access devices, and so on.

The processor 1000 may be a central processing unit (Central Processing Unit, CPU), and the processor 1000 may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), and application specific integrated circuits (Application Specific Integrated Circuits). , ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 1001 may be an internal storage unit of the terminal device 10 in some embodiments, such as a hard disk or a memory of the terminal device 10. In other embodiments, the memory 1001 may also be an external storage device of the terminal device 10, for example, a plug-in hard disk equipped on the terminal device 10, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital, SD) card, Flash Card, etc. Further, the memory 1001 may also include both an internal storage unit of the terminal device 10 and an external storage device. The memory 1001 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the computer program. The memory 1001 can also be used to temporarily store data that has been output or will be output.

As described above, the terminal device involved in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, and the like. Take the terminal device as a mobile phone as an example. FIG. 11 shows a block diagram of a part of the structure of a mobile phone provided in an embodiment of the present application. 11, the mobile phone may include: a radio frequency (RF) circuit 1110, a memory 1120, an input unit 1130, a display unit 1140, a sensor 1150, an audio circuit 1160, a wireless fidelity (WiFi) module 1170, a processor 1180, and power supply 1190 and other components. Those skilled in the art can understand that the structure of the mobile phone shown in FIG. 11 does not constitute a limitation on the mobile phone, and the mobile phone may include more or less components than those shown in the figure, or a combination of some components, or different component arrangements.

The following describes the components of the mobile phone in detail with reference to Figure 11:

The RF circuit 1110 can be used for receiving and sending signals during information transmission and communication or during a call. In particular, after receiving the downlink information of the base station, it is processed by the processor 1180; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit 1110 may include, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1110 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division) Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), Email, Short Messaging Service (SMS), etc.

The memory 1120 may be used to store software programs and modules. The processor 1180 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 1120. The memory 1120 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of mobile phones (such as audio data, phone book, etc.), etc. In addition, the memory 1120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The input unit 1130 may be used to receive inputted digital or character information, and generate key signal input related to user settings and function control of the mobile phone. Specifically, the input unit 1130 may include a touch panel 1131 and other input devices 1132. The touch panel 1131, also called a touch screen, can collect user touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 1131 or near the touch panel 1131. Operation), and drive the corresponding connection device according to the preset program. Optionally, the touch panel 1131 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 1180, and can receive and execute the commands sent by the processor 1180. In addition, the touch panel 1131 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1131, the input unit 1130 may also include other input devices 1132. Specifically, other input devices 1132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, joystick, etc.

The display unit 1140 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 1140 may include a display panel 1141. Optionally, the display panel 1141 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel 1131 can cover the display panel 1141. When the touch panel 1131 detects a touch operation on or near it, it transmits it to the processor 1180 to determine the type of the touch event, and then the processor 1180 responds to the touch event. The type provides corresponding visual output on the display panel 1141. Although in FIG. 11, the touch panel 1131 and the display panel 1141 are used as two independent components to implement the input and output functions of the mobile phone, but in some embodiments, the touch panel 1131 and the display panel 1141 can be integrated. Realize the input and output functions of the mobile phone.

In some embodiments, the display unit 1140 may include 1 or N display screens, where N is a positive integer greater than 1.

In some embodiments, when the display panel uses OLED, AMOLED, FLED and other materials, the above-mentioned display screen may be bent. Here, the above-mentioned display screen can be bent means that the display screen can be bent at any position along any axis to any angle, and can be maintained at that angle. For example, the display screen can be folded in half from the middle or up and down from the middle. . In the embodiments of the present application, the bent display screen may be referred to as a folding screen. Wherein, the folding screen may be one screen, or a display screen formed by patching together multiple screens, which is not limited here. The display screen can also be a flexible screen, which has the characteristics of strong flexibility and bendability, and can provide users with a new interactive mode based on bendable characteristics, which can meet more users' needs for folding screen mobile phones. For a mobile phone equipped with a folding screen, the folding screen on the mobile phone can be switched between the small screen in the folded form and the large screen in the expanded form at any time.

Exemplarily, the folding screen may include at least two physical forms: an expanded form and a folded form. The unfolded form refers to the angle formed by the left and right ends of the middle bending part of the folding screen (if the folding screen is folded up and down, the upper and lower ends of the middle bending part of the folding screen) that can be folded in half from the left and right sides Between 180 degrees and the first angle, where the first angle is greater than 0 degrees and less than 180 degrees, for example, the first angle may be 90 degrees). Folding form refers to the angle between the left and right ends of the middle bending part of the folding screen (if the folding screen is folded up and down, the upper and lower ends of the middle bending part of the folding screen) is between 0 degrees and the first Between angles. In the embodiment of the present application, the display area of the folding screen after entering the expanded form may be divided into a first display screen and a second display screen. In the unfolded configuration, the folding screen can be folded toward the direction facing the first display screen and the second display screen, and can also be folded toward the direction opposite to the first display screen and the second display screen. In some embodiments, the left and right ends of the middle bending part of the folding screen (if the folding screen is folded up and down, the upper and lower ends of the middle bending part of the folding screen) can form an angle between 0 degrees and +180. Between degrees. For example, the folding screen can be bent toward the direction facing the first display screen and the second display screen into a folded configuration with an included angle of 30 degrees, or it can face the first display screen and the second display screen opposite to each other. Bend in the opposite direction into a folded configuration with an included angle of 30 degrees.

In some embodiments, the mobile phone can use one or more of a gravity sensor, an acceleration sensor, and a gyroscope to determine whether the folding screen is in a folded form or an unfolded form. The mobile phone can also detect the bending angle of the folding screen through a gravity sensor, an acceleration touch sensor and a gyroscope. Then, the mobile phone can determine whether the folding screen is in a folded state or unfolded according to the bending angle. form. The mobile phone can also use one or more of a gravity sensor, an acceleration sensor and a gyroscope to determine the orientation of the folding screen in the folded form, and then determine the display area of the interface content output by the display system. For example, when the first display screen of the folding screen faces upward with respect to the ground, the mobile phone can display the interface content output by the display system on the first display screen. When the second display screen of the folding screen faces upward with respect to the ground, the mobile phone can display the interface content output by the display system on the second display screen.

In some embodiments, the mobile phone may further include an angle sensor (not shown in FIG. 11), and the angle sensor may be disposed at a bending part of the folding screen. The mobile phone can measure the angle formed by the two ends of the folding screen in the middle of the folding screen through an angle sensor (not shown in FIG. 11) provided at the bending part of the folding screen. When the angle is greater than or equal to the first When angled, the mobile phone can recognize that the folding screen enters the unfolded state through the angle sensor. When the included angle is less than or equal to the first angle, the mobile phone can recognize through the angle sensor that the folding screen enters the folded form.

In some other embodiments, the mobile phone can also recognize whether the folding screen is in a folded configuration through a physical switch provided at the bending part of the folding screen. For example, when the mobile phone receives a user's folding operation of the folding screen, the physical switch provided on the mobile phone is triggered to open, and the mobile phone can determine that the folding screen is in a folded form. When the mobile phone receives the user's unfolding operation of the folding screen, the physical switch set on the mobile phone is triggered to close, and the mobile phone can determine that the folding screen is in the unfolded form. The above examples are only used to explain the application and should not constitute a limitation.

The mobile phone may also include at least one sensor 1150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor can include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 1141 according to the brightness of the ambient light. The proximity sensor can close the display panel 1141 and/or when the mobile phone is moved to the ear. Or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three-axis), and can detect the magnitude and direction of gravity when it is stationary. Games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, percussion), etc.; as for other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which can also be configured in mobile phones, I will not here Go into details.

The audio circuit 1160, the speaker 1161, and the microphone 1162 can provide an audio interface between the user and the mobile phone. The audio circuit 1160 can transmit the electric signal converted from the received audio data to the speaker 1161, which is converted into a sound signal by the speaker 1161 for output; on the other hand, the microphone 1162 converts the collected sound signal into an electric signal, and the audio circuit 1160 After being received, it is converted into audio data, and then processed by the audio data output processor 1180, and sent to, for example, another mobile phone via the RF circuit 1110, or the audio data is output to the memory 1120 for further processing.

WiFi is a short-distance wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 1170. It provides users with wireless broadband Internet access. Although FIG. 11 shows the WiFi module 1170, it is understandable that it is not a necessary component of the mobile phone, and can be omitted as needed without changing the essence of the invention.

The processor 1180 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. Various functions and processing data of the mobile phone can be used to monitor the mobile phone as a whole. Optionally, the processor 1180 may include one or more processing units; preferably, the processor 1180 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, application programs, etc. , The modem processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 1180.

The mobile phone may further include a power supply 1190 (such as a battery) for supplying power to various components. Preferably, the power supply may be logically connected to the processor 1180 through a power management system, so that functions such as charging, discharging, and power consumption management can be managed through the power management system.

Although not shown, the mobile phone may also include a camera. Optionally, the position of the camera on the mobile phone may be front-mounted or rear-mounted, which is not limited in the embodiment of the present application.

Optionally, the mobile phone may include a single camera, a dual camera, or a triple camera, etc., which is not limited in the embodiment of the present application.

For example, a mobile phone may include three cameras, of which one is a main camera, one is a wide-angle camera, and one is a telephoto camera.

Optionally, when the mobile phone includes multiple cameras, the multiple cameras may be all front-mounted, or all rear-mounted, or partly front-mounted and another part rear-mounted, which is not limited in the embodiment of the present application.

In addition, although not shown, the mobile phone may also include a Bluetooth module, etc., which will not be repeated here.

Fig. 12 is a schematic diagram of the software structure of a mobile phone according to an embodiment of the present application. Taking the Android system as the mobile phone operating system as an example, in some embodiments, the Android system is divided into four layers, namely the application layer, the application framework layer (framework, FWK), the system layer, and the hardware abstraction layer. Through the software interface communication between.

As shown in FIG. 12, the application layer can be a series of application packages, and the application packages can include applications such as short message, calendar, camera, video, navigation, gallery, and call.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer may include some predefined functions, such as functions for receiving events sent by the application framework layer.

As shown in Figure 12, the application framework layer can include a window manager, a resource manager, and a notification manager.

The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take a screenshot, etc. The content provider is used to store and retrieve data and make these data accessible to applications. The data may include videos, images, audios, phone calls made and received, browsing history and bookmarks, phone book, etc.

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, and so on. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, prompt sounds, electronic devices vibrate, and indicator lights flash.

The application framework layer can also include:

A view system, which includes visual controls, such as controls that display text, controls that display pictures, and so on. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.

The phone manager is used to provide the communication function of the mobile phone. For example, the management of the call status (including connecting, hanging up, etc.).

The system layer can include multiple functional modules. For example: sensor service module, physical state recognition module, 3D graphics processing library (for example: OpenGL ES), etc.

The sensor service module is used to monitor the sensor data uploaded by various sensors at the hardware layer to determine the physical state of the mobile phone;

Physical state recognition module, used to analyze and recognize user gestures, faces, etc.;

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.

The system layer can also include:

The surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The hardware abstraction layer is the layer between hardware and software. The hardware abstraction layer can include display drivers, camera drivers, sensor drivers, etc., used to drive related hardware at the hardware layer, such as display screens, cameras, sensors, and so on.

The embodiments of the present application also provide a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the foregoing content presentation method embodiments can be implemented.

The embodiments of the present application provide a computer program product. When the computer program product runs on a terminal device, the terminal device can implement the steps in the above-mentioned content presentation method embodiments when executed.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the implementation of all or part of the processes in the above-mentioned embodiment methods in the present application can be accomplished by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When executed by the processor, the steps of the foregoing method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms. The computer-readable storage medium may at least include: any entity or device capable of carrying computer program codes to the terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM) , Random Access Memory), electric carrier signal, telecommunications signal and software distribution medium. For example, U disk, mobile hard disk, floppy disk or CD-ROM, etc. In some jurisdictions, in accordance with legislation and patent practices, computer-readable storage media cannot be electrical carrier signals and telecommunication signals.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail or recorded in an embodiment, reference may be made to related descriptions of other embodiments.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed device/terminal device and method may be implemented in other ways. For example, the device/terminal device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units. Or components can be combined or integrated into another system, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, a person of ordinary skill in the art should understand that it can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in Within the scope of protection of this application.

Claims

A content presentation method, characterized in that it is applied to a terminal device with a folding screen, and the method includes:

When a folding operation on the folding screen is detected, acquiring a content presentation mode of a current application, where the current application is an application currently being used in the terminal device;

If the content presentation mode is the normal mode, the target mode of the current application is started, and the content of the current application is presented through the target mode. The target modes are augmented reality AR mode, virtual reality VR mode and 3D At least one of the 3D modes.
The method according to claim 1, wherein the folding screen comprises a first display screen and a second display screen;

The presenting the content of the current application in the target mode includes:

The first content of the current application is presented in the first display screen in the target mode, and the second content of the current application is presented in the second display screen in the normal mode.
The method according to claim 2, wherein the terminal device includes a rear-mounted first camera device, the first display screen is a folded area in the folding screen, and the second display screen For an area of the folding screen excluding the first display screen, the first camera device is disposed at a position corresponding to the first display screen in the terminal device.
The method according to claim 3, wherein when the target mode is the AR mode, the presenting the first content of the current application in the first display screen in the target mode comprises:

Acquire a first real scene image corresponding to the current environment through the first camera device, and determine the indication position and indication of a navigation mark in the first real scene image according to the first real scene image, a preset map, and a preset navigation route direction;

The navigation mark is displayed in the instruction direction at the instruction location, and the first real scene image with the navigation mark is presented on the first display screen.
The method according to claim 3, wherein when the target mode is an AR mode, the presenting the first content of the current application in the target mode on the first display screen comprises:

Acquiring a second real scene image corresponding to the current environment through the first camera device, and acquiring a virtual image corresponding to the current application;

The virtual image is fused to the second real scene image, and the second real scene image fused with the virtual image is presented on the first display screen.
The method according to claim 5, wherein the terminal device further comprises a front-mounted second camera device, and the second camera device is provided in the terminal device corresponding to the first display screen. Location

The method also includes:

The user's interaction gesture is acquired through the second camera device, and the interaction with the current application is performed according to the interaction gesture.
The method according to any one of claims 1 to 6, wherein when a folding operation on the folding screen is detected, acquiring the content presentation mode of the current application comprises:

When a folding operation on the folding screen is detected, acquiring the first folding angle corresponding to the folding screen;

If the first folding angle is within the preset first angle interval, acquiring the content presentation mode of the current application.
The method according to any one of claims 1 to 7, wherein after the presenting the content of the current application in the target mode comprises:

Acquiring a second folding angle corresponding to the folding screen;

If the second folding angle is within the preset second angle interval, the target mode is closed, and the content of the current application is presented in the normal mode.
A content presentation device, characterized in that it is applied to a terminal device with a folding screen, and the device includes:

A mode obtaining module, configured to obtain a content presentation mode of a current application when a folding operation on the folding screen is detected, the current application being an application currently being used in the terminal device;

The content presentation module is configured to, if the content presentation mode is the normal mode, start the target mode of the current application, and present the content of the current application through the target mode, the target mode being an augmented reality AR mode, At least one of a virtual reality VR mode and a three-dimensional 3D mode.
A terminal device, comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program as claimed in claims 1 to 8. Any of the content presentation methods.
A computer-readable storage medium storing a computer program, wherein the computer program implements the content presentation method according to any one of claims 1 to 8 when the computer program is executed by a processor.