CN118502843A - Operation method and device for applet, electronic equipment and head-mounted display equipment - Google Patents

Abstract

The application provides an operation method and device for an applet, electronic equipment and head-mounted display equipment, comprising the following steps: the method comprises the steps of receiving an applet service operation instruction through a target application program, binding the applet service with the target application program, waking up the applet service in response to a successful binding determination result of the applet service and the target application program, establishing a communication mechanism between the applet service and the target application program, opening a webpage view of the applet service in the target application program, and opening the target applet in the target application program in response to receiving the operation instruction of the target applet displayed in the webpage view of the applet service. Thus, the application realizes the opening of the applet in the applet service by the target application program by binding the applet service with the target application program.

Description

Operation method and device for applet, electronic equipment and head-mounted display equipment

Technical Field

The embodiment of the application relates to the technical field of man-machine interaction, in particular to an operation method and device for an applet, electronic equipment and head-mounted display equipment.

Background

With the popularization and development of various types of expansion type electronic devices (e.g., expansion reality devices, wearable devices, etc.), higher requirements are also put on applications that the expansion type electronic devices can support to run.

In the current various application programs, the applet can be used without downloading and installing, so that the application program is more widely used. The applet meets the service demands of different fields such as living services (such as shopping, dining, travel, traffic, weather inquiry, health management and the like), social entertainment (such as chatting, video, games and the like), education and learning (such as online education, learning tools, teaching training and the like), and becomes one of the application programs with highest daily use frequency for vast users.

In view of this, a technical solution for supporting the running of applets in an extended electronic device is needed.

Disclosure of Invention

According to a first aspect of an embodiment of the present application, there is provided an operation method for an applet, including: receiving an applet service operation instruction through a target application program, and binding the applet service with the target application program, wherein the applet service comprises at least one applet; in response to a determination that the applet service and the target application are successfully bound, waking up the applet service, and establishing a communication mechanism between the applet service and the target application; opening a web page view of the applet service in the target application based on the established communication mechanism, wherein the web page view of the applet service is used for displaying at least one applet; and opening the target applet in the target application program in response to receiving the operation instruction of the target applet displayed in the webpage view of the applet service, wherein the target applet is any one of the at least one applet.

According to a second aspect of an embodiment of the present application, there is provided an operating device for an applet, including: the binding module is used for receiving the operation instruction of the applet service through the target application program and binding the applet service with the target application program, wherein the applet service comprises at least one applet; the communication module is used for waking up the applet service in response to a determination result that the applet service and the target application program are successfully bound, and establishing a communication mechanism between the applet service and the target application program; the webpage view opening module is used for opening a webpage view of the applet service in the target application program based on the established communication mechanism, wherein the webpage view of the applet service is used for displaying at least one applet; and the operation module is used for responding to the operation instruction of the target applet displayed in the webpage view of the applet service, and opening the target applet in the target application program, wherein the target applet is any one of at least one applet.

According to a third aspect of an embodiment of the present application, there is provided an electronic apparatus including: the device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface are communicated with each other through the communication bus; the memory is configured to store at least one executable instruction that causes the processor to perform operations corresponding to the method according to the first aspect.

According to a fourth aspect of embodiments of the present application, there is provided a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to the first aspect.

According to a fifth aspect of an embodiment of the present application, there is provided a head-mounted display device including: a processing unit, configured to open a web page view of an applet service in a target application using the method of the first aspect, where the web page view of the applet service is used to display at least one applet in the applet service; and the display unit is connected with the processing unit and is used for rendering the webpage view to the space virtual screen so as to display the webpage view through the space virtual screen.

According to the running method, the running device, the electronic equipment and the head-mounted display equipment for the applet, which are provided by the embodiments of the application, according to the applet service running instruction received by the target application program, the binding operation between the applet service and the target application program can be directly executed, and the webpage view of the applet service is opened in the target application program so as to run the applet in the target application program. Therefore, the application realizes the operation of the applet in the extended electronic equipment by binding the applet service with the target application program of the extended electronic equipment so as to open the applet in the applet service through the target application program.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments described in the embodiments of the present application, and other drawings may be obtained according to these drawings for a person having ordinary skill in the art.

FIG. 1 is an exemplary system architecture diagram for an operating method or apparatus for applets, as applied to the application.

Fig. 2 is a process flow diagram of a method of operation for an applet in an exemplary embodiment of the application.

Fig. 3 is an image rendering process flow of the head-mounted display device according to an exemplary embodiment of the present application.

Fig. 4 is a process flow diagram of a method of operation for an applet in accordance with another exemplary embodiment of the application.

Fig. 5 is a block diagram of an operating apparatus for an applet according to an exemplary embodiment of the present application.

Fig. 6 is a block diagram of an electronic device according to an exemplary embodiment of the present application.

Detailed Description

In order to better understand the technical solutions in the embodiments of the present application, the following description will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments derived by a person skilled in the art from the embodiments according to the application shall fall within the scope of protection of the embodiments according to the application. It should be noted that, without conflict, embodiments of the present disclosure and features of the embodiments may be combined with each other.

The implementation of the embodiments of the present application will be further described below with reference to the accompanying drawings.

FIG. 1 is an exemplary system architecture diagram applicable to the method or apparatus of operation for an applet in the present application. As shown, the system architecture 100 may include a display unit 102 and a processing unit 104.

The display unit 102 and the processing unit 104 may be connected by a wired or wireless connection. The display unit 202 may be various expansion type electronic devices having a display function. The expansion type electronic device may be a non-general purpose computing device other than a general purpose computer device such as a smart phone, a notebook computer, a desktop computer, a general purpose tablet, and the like. Expansion electronics include, but are not limited to: AR (augmented reality), VR (virtual reality), etc. The processing unit 104 may be various electronic devices with data computing capabilities, including but not limited to: electronic devices such as smart phones, tablet computers, adapters, screen throwers, notebook computers and the like.

As an example, in the system architecture 100 shown in fig. 1, the processing unit 104 may be an adapter, a projector, or a cell phone, and the display unit 102 may be AR glasses or VR glasses connected with the processing unit 104 to constitute a split head-mounted display device, where the processing unit 104 may provide computing power for the operation of the display unit 102.

In some alternative embodiments, the display unit 102 and the processing unit 104 may also be of unitary structural design to form a unitary head mounted display device. For example, the corresponding computing power may be provided for the operation of the integrated head mounted display device by a computing unit built into the integrated head mounted display device.

The display unit 102 and the processing unit 104 may be used in combination to perform the method of operation of the application for applets. For example, the processing unit 104 may be configured to install a target application (e.g., an augmented reality application) and an applet service, and open a web page view of the applet service in the target application to expose and run the applet in the applet service (e.g., a beauty takeaway, a fighter, etc. applet in a WeChat applet service). The display unit 102 may render the web page view to the spatial virtual screen such that the web page view is displayed in the spatial virtual screen by the head-mounted display device. Among these, applet services may be understood as computer software for opening an applet, e.g., a WeChat applet service, a WeChat application, etc.

In the related art, an extended electronic device does not have an operating environment of an application program capable of opening an applet, and the running of the application program can be realized by performing secondary development on a software development kit or the like of the application program running the applet. In order to open the applet in the extended electronic device, the applet service is bound with the target application program of the extended electronic device, and the applet in the applet service is opened through the target application program, so that the applet is operated in the extended electronic device without secondary development of the application program or the software development kit of the service for operating the applet.

Alternatively, when the applet is run by the target application, a wake operation of the applet service needs to be performed first. In general, a system foreground of an operating system (e.g., android system, ios system) can only run one task program in the same period, but the target application program and the applet service belong to two different task programs, so that the operation of waking up the applet service can cause the currently running target application program to be suspended and start to run the applet service in the foreground. Typically, a wake operation of the applet service will trigger the target application to be suspended. Therefore, when the main body foreground is executed and the task can only be singly started, the scheme disclosed by the application binds the applet service with the target application program before opening the webpage view of the applet service, so that the condition that the target application program is suspended when opening the applet can be avoided.

Optionally, in the case that the extended electronic device is a dual-screen display, for example, the head-mounted display device is a split device, the display unit such as the head-mounted display device has a first display screen, the computing unit such as the mobile phone has a second display screen, and when the target application program runs, the display unit displays a content screen interface, and the computing unit displays an operation interface as a handle. In the process that the task program running in the foreground of the computing unit system is switched from the target application program to the applet service, the equipment operation interface (such as the mobile phone operation interface) is also switched from the interaction interface of the target application program to the interaction interface of the applet service, and the target application program is suspended. At this time, after the applet service is successfully awakened, the applet service is displayed on the second display screen, the user cannot operate the interface displayed on the display screen of the display unit, and the user can only transfer from the first display screen to the second display screen to operate, and after the applet service is successfully bound, the device operation interface is returned to the interactive interface of the target application program from the interactive interface of the applet service. In addition, in the case where the target application is an AR application, since the target application is responsible for displaying an AR scene in the AR glasses, if the operation of the target application is interrupted, the AR scene display effect in the AR glasses is also simultaneously affected. According to the scheme disclosed by the application, the target application program and the applet service can be bound first, and then the applet is awakened, so that the condition that the target application program pauses operation can be avoided, and the use experience of a user is improved.

Fig. 2 is a process flow diagram of a method of operation for an applet in an exemplary embodiment of the application. The method of the present embodiment includes the steps of:

Step S202, receiving an applet service operation instruction through a target application program, and binding the applet service with the target application program.

In some alternative embodiments, the applet service is a computer program for opening the applet, which may include, but is not limited to, a WeChat applet service. The applet service may include at least one applet, for example, an applet such as "beauty take-out" or "fighting land owner" in the WeChat applet service. The applet included in the applet service may be opened by the applet service.

In some alternative embodiments, the target application may be an application running an extended electronic device, which may include, but is not limited to: and (5) expanding the reality application program. The augmented reality application is used to implement the display effect of augmented reality on a head mounted display device (e.g., display unit 102 shown in fig. 1).

For example, the extended application may be an augmented reality application (AR application), a virtual reality application (VR application), a mixed reality application (MR application), or the like.

In some alternative embodiments, an electronic device (e.g., processing unit 104 shown in FIG. 1) running the running method for the applet may detect the installation status of the applet service in the target application based on applet service running instructions received by the target application prior to performing the step of binding the applet service with the target application.

In this embodiment, if the detection result is that the applet service has been installed in the target application, the binding operation between the applet service and the target application may be directly performed. If the detection result is that the applet service is not installed in the target application program, the applet service is installed in the target application program, and after the applet service is installed in the target application program, the binding operation between the applet service and the target application program is executed.

By way of example, the target application (e.g., an augmented reality application) may be opened in the electronic device to display an interactive interface of the target application. The applet service may be opened in the interactive interface of the target application (e.g., clicking on an application icon of the WeChat applet service in the interactive interface of the augmented reality application) to trigger the applet service run instructions. The binding operation of the applet service (e.g., the WeChat applet service) with the target application (e.g., the augmented reality application) may be performed based on receiving applet service execution instructions through the target application.

In some alternative embodiments, the applet service may be bound to the target application by calling an interface (API) provided by the applet service.

In step S204, in response to the determination that the applet service and the target application are successfully bound, the applet service is awakened, and a communication mechanism is established between the applet service and the target application.

In some alternative embodiments, if the applet service and the target application are successfully bound, a response message of on Service Connected is triggered.

In some alternative embodiments, a wake operation of the applet service may be performed when a determination is made that the applet service is successfully bound to the target application. It should be noted that, in the embodiments of the present application, even if the system foreground of the electronic device can only run in a single task, when the applet service is successfully bound to the target application, the wake operation of the applet service is executed, the running of the target application will not be paused, and the device operation interface (e.g., a touch screen of a mobile phone) will not be jumped from the interactive interface of the target application to the interactive interface of the applet service.

In some alternative embodiments, before the step of waking up the applet service is performed, the target application may be controlled to send device authentication request information to the applet service, and wake up the applet service according to a response result returned by the applet service for device authentication. By way of example, the applet service may be provided to perform device authentication operations on the operating device of the target application using public-private key encryption, thereby improving the security of device access operations.

Step S206, opening the web page view of the applet service in the target application program based on the established communication mechanism.

In some alternative embodiments, when the target application is successfully bound to the applet service, a messaging mechanism may be established between the target application and the applet service to inform the target application that it is ready. The web page view (e.g., webview page) of the applet service may then be opened in the target application through the established communication mechanism.

In some alternative embodiments, the web page view of the applet service may be a first page of the applet service for displaying individual applets in the applet service (e.g., the WeChat applet service first page may display "beauty take away", "fighter", etc. applets).

In some alternative embodiments, the target application may be used to drive the head mounted display device to implement an augmented reality display. And when the target application program runs, the space virtual screen plug-in can be acquired, and the space virtual screen is displayed in the head-mounted display. Wherein, the display position of the space virtual screen can be determined according to the space distribution information of the head-mounted display device. The web page view to be displayed may then be rendered to the spatial virtual screen so that the web page view may be displayed through the spatial virtual screen of the head-mounted display device. The spatial distribution information described above may be used to characterize the spatial distribution of the head mounted display device. The spatial distribution information may include pose information or posture information, and thus the pose or posture of the spatial virtual screen may be determined according to the pose and posture of the head-mounted display device, so that the head-mounted display device may implement three-degree-of-freedom or six-degree-of-freedom display.

By way of example, where the applet service is a WeChat applet service, a web page view of the WeChat applet service (e.g., a web page view of the WeChat applet service's home page) may be rendered onto the spatial virtual screen by accessing a link of the WeChat applet service (which is typically the home page link of the WeChat applet service).

Referring to fig. 3, as an example, a web page view of an applet service (e.g., a WeChat applet service) in a smartphone is displayed in a head-mounted display device (e.g., AR glasses or VR glasses), and the process flow mainly includes:

When an electronic device such as a mobile phone is used as a computing unit to run a target application, motion sensing data (e.g., IMU data (inertial measurement data) or the like) of the head-mounted display device may be acquired. And then performing pose or posture calculation (for example, 3dof or 6dof calculation) of the head-mounted display device according to the acquired motion sensing data so as to determine current pose information or pose information (for example, 3dof pose information or 6dof pose information) of the head-mounted display device.

Based on a communication mechanism established between the target application and the applet service, the applet service or applet web page view may be opened in the target application, and the acquired web page view and current pose information or pose information of the head-mounted display device may be provided to an SDK (software development kit) to provide the web page view to be rendered, and the current pose information or pose information of the head-mounted display device, to an image rendering engine (e.g., unit) via an interface of the SDK. The image rendering engine can determine the distribution of the space virtual screen in space according to the current gesture or pose information of the head-mounted display device, and render the webpage view to the space virtual screen. Finally, the rendered webpage view is transmitted to a display screen of the head-mounted display device by the SDK, so that an image on the display screen can enter human eyes through the optical system. Thus, the user can see a view of the web page displayed by the spatial virtual screen.

Step S208, in response to receiving the operation instruction of the target applet displayed in the webpage view of the applet service, opening the target applet in the target application.

In some alternative embodiments, the target applet may be any applet in the applet service.

In some alternative embodiments, after opening a web page view of the applet service in the target application, the user may interact with the applets displayed in the web page view by way of rays or the like in an augmented reality space (e.g., AR space or VR space) provided by the head-mounted display device.

For example, the user may display each applet from the web page view in a radial manner, and select any applet as the target applet (e.g., select the "fight host" applet in the applet service front page by clicking) to trigger the running instruction of the target applet, thereby opening the web page view (e.g., webview page) of the target applet in the target application.

In some alternative embodiments, the front page of the applet displayed in the web page view will typically include a login button that, when clicked by the user, will invoke the login API interface of the applet service to display the authorization page of the applet service. The user can log in on the authorization page, thereby realizing the identity authentication in the applet and the acquisition of personal information.

In some alternative embodiments, if it is detected that the applet service is turned off (also referred to as an applet service exit), the binding state between the target application and the applet service may be released until the applet service is again bound to the target application to wake up the applet service when the applet service operation instruction is received by the target application (e.g., the user clicks the applet service in the target application). It will be appreciated that the applet service close instruction may be generated when all of the applet's web page views are received to be closed. Or upon receiving a web page view closure of the applet service, an applet service closure instruction may be generated. The applet service may be determined to be closed based on the applet service close instruction.

In summary, according to the technical scheme provided by the embodiment, when the running target application program receives the running instruction of the applet service running, the applet service and the target application program can be bound. And under the condition that the applet service and the target application program are successfully bound, the applet service is awakened, a communication mechanism between the applet service and the target application program is established, and then a webpage view of the applet service can be opened in the target application program, so that the applet can be operated in the expansion type electronic equipment without secondary development of an application program or a software development kit of the service for operating the applet.

It can be understood that under the condition that the electronic equipment can only run in a single task, the scheme disclosed by the application does not need to wake up the applet service, and the binding operation of the applet service and the target application program can be directly executed, so that the use experience of a user on the target application program is improved, and the operation steps of starting the running applet in the target application program are reduced.

Specifically, in the prior art, if the applet needs to be run in the target application, the applet service needs to be awakened first, and this awakening operation may cause the target application running in the foreground to be forcedly interrupted (typically, the awakening operation of the applet service may trigger the target application to be paused for 2 seconds), and the applet service is run in the foreground of the electronic device. Meanwhile, the operation interface of the device is also jumped to the interaction interface of the applet service from the interaction interface of the target application program, and after the applet service is successfully awakened, the operation interface of the device is switched back to the interaction interface of the target application program from the interaction interface of the applet service in a manual operation mode. In view of this, the technical solution provided in this embodiment may run the applet in the target application without suspending the running of the target application, which not only expands the types of programs that can support running in the target application, so as to meet the diversified use requirements of the user on the target application, but also improves the use experience of the user on the target application.

Furthermore, according to the technical scheme provided by the embodiment, before the wake-up operation of the applet service is executed, the applet service is provided to execute the device authentication operation on the operating device of the target application program, so that the security of the program access operation is improved.

In addition, the embodiment can improve the binding success rate between the applet service and the target application by detecting the installation state of the applet service in the target application before executing the step of binding the applet service with the target application.

In addition, in the technical scheme provided by the embodiment, under the condition that the target application program is the augmented reality application program, the opening and running operation of the applet in the augmented reality application program can be realized without suspending the running of the augmented reality application program, so that the display effect of the augmented reality device is not affected, and the use experience of a user on the augmented reality device is improved. Therefore, the running scheme for the applet provided in the embodiment is particularly suitable for application scenes of the augmented reality device (such as AR glasses and VR glasses).

In addition, according to the technical scheme provided by the embodiment, if the applet service is detected to be closed or the applet service is detected to exit, the binding state between the target application program and the applet service can be released until the applet service is triggered again. By the technical means, the calculation power of the system can be reduced, the running power consumption of the system can be reduced, and the power consumption of equipment can be reduced.

Fig. 4 is a process flow diagram of a method of operation for an applet in accordance with another exemplary embodiment of the application. The method of the present embodiment includes the steps of:

Step S402, receiving an applet service operation instruction through the target application program, and binding the applet service with the target application program.

For the detailed description of this step, reference may be made to the description of step S202 in the embodiment of fig. 2, which is not repeated here.

Step S404, judging whether the binding between the applet service and the target application program is successful, if yes, executing step S204, otherwise, executing step S406.

In some alternative embodiments, if the binding between the applet service and the target application program is successful (yes in step S404), a response message of on Service Connected is triggered; if the binding between the applet service and the target application fails (no in step S404), a response message of on Service Disconnected is triggered.

In step S406, in response to the determination result that the applet service and the target application fail to bind, the background server of the target application is controlled to wake up the applet service, run the applet service, and bind the applet service and the target application.

In some alternative embodiments, when a determination result that the applet service fails to bind to the target application is obtained, a wake activity (activity) may be initiated at the background server of the target application to control the background server of the target application to send a wake request to the applet service. Then, the binding operation between the applet service and the target application program can be executed according to the wake-up response result returned by the applet service. Optionally, under the condition that the electronic device running by the method of the embodiment supports only a single task, if the applet service returns a wake-up response result, the object application running in the foreground may be suspended, and the waken applet service is running in the foreground, so that the binding process between the applet service and the object application may be executed.

In step S408, in response to the determination that the applet service and the target application are successfully bound, a communication mechanism is established between the applet service and the target application, and step S206 is continued.

In some alternative embodiments, when the target application is successfully bound to the applet service, a message communication mechanism may be established between the target application and the applet service to inform the target application that it is ready, and proceed to step S206, where a web page view of the applet service is opened in the target application by the established communication mechanism.

In summary, according to the technical scheme provided by the embodiment, when the binding failure between the target application program and the applet service is determined, the applet service can be awakened in advance, and the binding operation between the target application program and the applet service is tried to be executed again, so that the binding success rate between the target application program and the applet service is improved, and smooth opening and running of the applet in the target application program are ensured.

The embodiments of fig. 2 to 4 are described above, and the implementation means of the method for operating an applet according to the present application have been disclosed in detail. It should be understood by those skilled in the art that the operation method for an applet described in any of the above embodiments may be used in combination with any of the existing augmented reality devices or wearable devices, and the future developed augmented reality devices or wearable devices according to practical application requirements, and the present application is not limited thereto.

Fig. 5 shows a block diagram of the operation device 500 for an applet according to an exemplary embodiment of the present application.

The running device 500 for the applet of the present embodiment may include any type of electronic device, such as a wearable electronic device (e.g., smart glasses, smart watch, etc.), a computer, a server, etc.

As shown in the drawing, the running apparatus 500 for an applet of the present embodiment includes: binding module 502, communication module 504, web page view opening module 506, and running module 508.

A binding module 502, configured to receive, by the target application, an applet service running instruction, and bind the applet service to the target application, where the applet service includes at least one applet.

And the communication module 504 is used for waking up the applet service and establishing a communication mechanism between the applet service and the target application program in response to the determination that the applet service and the target application program are successfully bound.

A web page view opening module 506, configured to open a web page view of the applet service in the target application program based on the established communication mechanism, where the web page view of the applet service is used to display at least one applet.

And an operation module 508, configured to open a target applet in the target application in response to receiving an operation instruction of the target applet displayed in the web page view of the applet service, where the target applet is any one of the at least one applet.

In some alternative embodiments, the binding module 502 is further configured to: responding to the determination result of failure in binding the applet service with the target application program, controlling a background server of the target application program to wake up the applet service, running the applet service, and binding the applet service with the target application program; and establishing a communication mechanism between the applet service and the target application program in response to the determination that the applet service and the target application program are successfully bound.

In some alternative embodiments, the binding module 502 is further configured to: in response to a determination result that the applet service fails to bind with the target application program, starting a wake-up activity at a background server of the target application program, and controlling the background server of the target application program to send a wake-up request to the applet service; according to the wake-up response result returned by the applet service, suspending running the target application program; and running the applet service in the foreground and binding the applet service with the target application program.

In some alternative embodiments, the communication module 504 is further configured to: before waking up the applet service, controlling the target application program to transmit device authentication request information to the applet service; and waking up the applet service according to a response result returned by the applet service and passing the device authentication.

In some alternative embodiments, the binding module 502 is further configured to: before the applet service is bound with the target application program, detecting the installation state of the applet service in the target application program according to the applet service operation instruction; if the detection result is that the applet service is installed in the target application program, executing the step of binding the applet service with the target application program; if the detection result is that the applet service is not installed in the target application program, installing the applet service in the target application program, and executing the step of binding the applet service with the target application program after installing the applet service in the target application program.

In some alternative embodiments, the target application is an augmented reality application for implementing an augmented reality display on a head mounted display device.

In some alternative embodiments, the web page view opening module 506 is further configured to: acquiring a space virtual screen plug-in through a target application program, and determining the space distribution of the space virtual screen according to the space distribution information of the head-mounted display equipment; and rendering the webpage view to the space virtual screen according to the determined result of the space distribution of the space virtual screen so that the webpage view is displayed in the space virtual screen through the head-mounted display device.

In some alternative embodiments, the binding module 502 is further configured to: if the applet service is detected to be closed, the binding state between the target application program and the applet service is released.

Referring to fig. 6, a schematic structural diagram of an electronic device according to an embodiment of the present application is shown, and the specific embodiment of the present application is not limited to the specific implementation of the electronic device.

As shown in fig. 6, the electronic device of the present embodiment may include: a processor 602, a communication interface Communications Interface, a memory 606, and a communication bus 608.

Processor 602, communication interface 604, and memory 606 perform communication with each other via communication bus 608.

Communication interface 604 for communicating with other electronic devices or servers.

The processor 602 is configured to execute the program 610, and may specifically perform relevant steps in the embodiment of the method for operating the applet described above.

In particular, program 610 may include program code including computer-operating instructions.

The processor 602 may be a CPU, or an Application-specific integrated Circuit ASIC (Application SPECIFIC INTEGRATED Circuit), or one or more integrated circuits configured to implement embodiments of the present application. The one or more processors comprised by the smart device may be the same type of processor, such as one or more CPUs; but may also be different types of processors such as one or more CPUs and one or more ASICs.

A memory 606 for storing a program 610. The memory 606 may comprise high-speed RAM memory or may further comprise non-volatile memory (non-volatile memory), such as at least one disk memory.

The program 610 may include a plurality of computer instructions, and the program 610 may specifically enable the processor 602 to perform operations corresponding to the running method for the applet described in any one of the above-mentioned method embodiments.

The specific implementation of each step in the program 610 may refer to the corresponding steps and corresponding descriptions in the units in the above method embodiments, and have corresponding beneficial effects, which are not described herein. It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the apparatus and modules described above may refer to corresponding procedure descriptions in the foregoing method embodiments, which are not repeated herein.

The present application also provides a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method described in any of the preceding method embodiments. The computer storage media includes, but is not limited to: a compact disk read Only (Compact Disc Read-Only Memory, CD-ROM), random access Memory (Random Access Memory, RAM), floppy disk, hard disk, magneto-optical disk, or the like.

Embodiments of the present application also provide a computer program product including computer instructions that instruct a computing device to perform operations corresponding to the method of operation for an applet described in any of the above embodiments.

The head-mounted display device of the embodiment of the application comprises: the device comprises a processing unit and a display unit.

The processing unit is configured to open a web page view of an applet service in a target application program by using the running method for an applet according to any one of the above embodiments.

Wherein the web page view of the applet service is operable to display at least one applet in the applet service.

The display unit is connected with the processing unit and used for rendering the webpage view to the space virtual screen so as to display the webpage view through the space virtual screen.

In some alternative embodiments, the head mounted display device includes, but is not limited to: VR smart glasses, AR smart glasses, MR smart glasses, etc.

In some alternative embodiments, the head mounted display device comprises a unitary head mounted display device or a split head mounted display device.

In an embodiment, the head-mounted display device is a one-piece head-mounted display device, and the processing unit and the display unit may be integrally disposed in the head-mounted display device.

In another embodiment, the head-mounted display device is a split head-mounted display device, and the head-mounted display device may include a head-mounted display device and a terminal device, where the head-mounted display device is, for example, AR glasses, VR glasses, MR glasses, and the like. The terminal device is, for example, a mobile phone, a tablet, a computer, etc. In this embodiment, the processing unit may be disposed in the terminal device and configured to render the web page view to the spatial virtual screen, so as to display the web page view through the spatial virtual screen.

In summary, by using the method described in any one of the embodiments, the head-mounted display device of the present embodiment opens a web page view of the applet service in the target application program, and renders the web page view to the spatial virtual screen, so as to display the web page view through the spatial virtual screen, thereby implementing interactive operation on the applet in the virtual space displayed by the spatial virtual screen, and improving interactive use experience of the user on the head-mounted display device.

For example, a user may open an AR application in a mobile phone and open a WeChat applet service in the AR application, that is, may display webView pages of the WeChat applet service in an AR space provided by a head-mounted display device, and the user may use a ray to interact with each applet (e.g., a beauty takeout, a fighting owner, etc.) displayed in a web page view in the AR space, calculate a position of the intersection in webView pages when the ray intersects webView pages of the AR space, and transfer the position to a webView control. And through transmitting clicking, sliding and dragging information of the AR space to the webView control, interactive operations such as clicking, sliding and dragging of the applet in the AR space are realized.

It should be noted that, according to implementation requirements, each component/step described in the embodiments of the present application may be split into more components/steps, or two or more components/steps or part of operations of the components/steps may be combined into new components/steps, so as to achieve the objects of the embodiments of the present application.

The methods according to embodiments of the present application described above may be implemented in hardware, firmware, or as software or computer code storable in a recording medium such as a CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk, or as computer code originally stored in a remote recording medium or a non-transitory machine-readable medium and to be stored in a local recording medium downloaded through a network, so that the methods described herein may be processed by such software on a recording medium using a general purpose computer, a special purpose processor, or programmable or dedicated hardware such as an Application SPECIFIC INTEGRATED Circuit (ASIC), or field programmable gate array (Field Programmable GATE ARRAY, FPGA). It is understood that a computer, processor, microprocessor controller, or programmable hardware includes a Memory component (e.g., random access Memory (Random Access Memory, RAM), read-Only Memory (ROM), flash Memory, etc.) that can store or receive software or computer code that, when accessed and executed by the computer, processor, or hardware, performs the methods described herein. Furthermore, when a general purpose computer accesses code for implementing the methods illustrated herein, execution of the code converts the general purpose computer into a special purpose computer for performing the methods illustrated herein.

Those of ordinary skill in the art will appreciate that the elements and method steps of the examples described in connection with the embodiments disclosed herein can be implemented as electronic hardware, or as a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present application.

The above embodiments are only for illustrating the embodiments of the present application, but not for limiting the embodiments of the present application, and various changes and modifications may be made by one skilled in the relevant art without departing from the spirit and scope of the embodiments of the present application, so that all equivalent technical solutions also fall within the scope of the embodiments of the present application, and the scope of the embodiments of the present application should be defined by the claims.

Claims (11)

1. A method of operation for an applet, comprising:

Receiving an applet service operation instruction through a target application program, and binding the applet service with the target application program, wherein the applet service comprises at least one applet;

In response to a determination that the applet service and the target application are successfully bound, waking up the applet service, and establishing a communication mechanism between the applet service and the target application;

opening a web page view of the applet service in the target application based on the established communication mechanism, wherein the web page view of the applet service is used for displaying the at least one applet;

and responding to the received operation instruction of the target applet displayed in the webpage view of the applet service, opening the target applet in the target application program, wherein the target applet is any one of the at least one applet.

2. The method of claim 1, wherein the method further comprises:

responding to a determination result of failure in binding of the applet service and the target application program, controlling a background server of the target application program to wake up the applet service, running the applet service, and binding the applet service and the target application program;

And establishing a communication mechanism between the applet service and the target application program in response to the determination that the applet service is successfully bound to the target application program.

3. The method of claim 2, wherein the controlling the background server of the target application to wake up the applet service, run the applet service, and bind the applet service with the target application in response to the determination that the applet service fails to bind with the target application comprises:

responding to a determination result that the applet service and the target application program are failed to bind, starting a wake-up activity at a background server of the target application program, and controlling the background server of the target application program to send a wake-up request to the applet service;

suspending running the target application program according to a wake-up response result returned by the applet service;

and running the applet service in the foreground, and binding the applet service with the target application program.

4. A method according to any one of claims 1 to 3, wherein prior to performing the step of waking up the applet service, the method comprises:

controlling the target application program to send equipment authentication request information to the applet service;

and waking up the applet service according to a response result returned by the applet service and passing the equipment authentication.

5. The method of claim 1, wherein prior to performing the step of binding the applet service with the target application, the method comprises:

Detecting the installation state of the applet service in the target application program according to the applet service operation instruction;

wherein,

If the detection result is that the applet service is installed in the target application program, executing the step of binding the applet service with the target application program;

And if the detection result is that the applet service is not installed in the target application program, installing the applet service in the target application program, and executing the step of binding the applet service with the target application program after the applet service is installed in the target application program.

6. The method of claim 1, wherein the target application is an augmented reality application for implementing an augmented reality display on a head mounted display device;

wherein the opening the web page view of the applet service in the target application program comprises:

Acquiring a space virtual screen plug-in through the target application program, and determining the space distribution of the space virtual screen according to the space distribution information of the head-mounted display equipment;

and rendering the webpage view to the space virtual screen according to the determined result of the space distribution of the space virtual screen so that the webpage view is displayed in the space virtual screen through the head-mounted display device.

7. The method according to claim 1, wherein the method further comprises:

and if the applet service is detected to be closed, the binding state between the target application program and the applet service is released.

8. An operating device for an applet, comprising:

The binding module is used for receiving an applet service operation instruction through a target application program and binding the applet service with the target application program, wherein the applet service comprises at least one applet;

the communication module is used for waking up the applet service in response to a determination result that the applet service is successfully bound with the target application program, and establishing a communication mechanism between the applet service and the target application program;

A web page view opening module, configured to open a web page view of the applet service in the target application program based on the established communication mechanism, where the web page view of the applet service is used to display the at least one applet;

And the operation module is used for responding to the operation instruction of the target applet displayed in the webpage view of the applet service, and opening the target applet in the target application program, wherein the target applet is any one of the at least one applet.

9. An electronic device, comprising:

A processor; and

A memory storing a program;

wherein the program comprises instructions which, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 7.

10. A computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of claims 1 to 7.

11. A head mounted display device comprising:

A processing unit for opening a web page view of an applet service in a target application using the method according to any one of claims 1 to 7, wherein the web page view of the applet service is used for displaying at least one applet in the applet service;

And the display unit is connected with the processing unit and is used for rendering the webpage view to a space virtual screen so as to display the webpage view through the space virtual screen.