CN114896014A - Desktop image display method, device, equipment and storage medium - Google Patents

Abstract

The invention discloses a desktop image display method, a desktop image display device, desktop image display equipment and a storage medium. The host system outputs a host desktop image based on the first display card and displays the host desktop image on a display screen by starting the host system and isolating the second display card, wherein the second display card is directly communicated with the virtual machine system; starting the virtual machine system through the host system so that the virtual machine system obtains a virtual machine desktop image based on rendering of the second display card; the method has the advantages that the desktop image of the virtual machine is obtained through the display service of the host system, the desktop image of the virtual machine is displayed on the display screen based on the first display card, the problem that the virtual machine systems such as games or entertainment and the like are independently connected with the display card and one display screen is additionally configured to display the desktop image of the virtual machine system is solved, the desktop image of the virtual machine system which is independently connected with the display card is displayed on the display screen of the host system, the number of the display screens is reduced, the cost is effectively reduced, and the good expandability is realized.

Description

Desktop image display method, device, equipment and storage medium

Technical Field

The invention relates to the technical field of computers, in particular to a desktop image display method, a desktop image display device, desktop image display equipment and a storage medium.

Background

With the increase of chip processing capacity, a plurality of virtual machine systems including entertainment systems, game systems and other systems are operated by using one chip in the field of the current vehicle-mounted cockpit, so that richer vehicle-mounted entertainment experience is brought to users.

Entertainment systems and game systems generally require high Graphics Processing Unit (GPU) rendering capability, and GPU virtualization schemes are developed at the same time, but GPU virtualization results in loss or resource occupation with other virtual machines, resulting in unsatisfactory rendering effect and poor vehicle-mounted entertainment experience.

In order to improve game experience, the independent display card can be directly communicated to a virtual machine system such as games or entertainment and the virtual machine system can be used independently, so that better rendering capability is ensured, but an additional display screen is required to be configured to display a desktop image of the virtual machine system. However, it is very expensive to additionally configure a display screen to display the desktop of the virtual machine system based on cost and space considerations.

Disclosure of Invention

The invention provides a desktop image display method, a device, equipment and a storage medium, which are used for solving the problem that a virtual machine system such as games or entertainment and the like is independently connected with a display card and an additional display screen is required to be configured to display a desktop image of the virtual machine system.

According to an aspect of the present invention, there is provided a desktop image display method applied to a terminal device, the method including:

starting a host system and isolating a second display card, so that the host system outputs a host desktop image based on the first display card and displays the host desktop image on a display screen; the second display card is directly communicated with the virtual machine system;

starting a virtual machine system through the host system so that the virtual machine system obtains a virtual machine desktop image based on the second display card rendering;

and acquiring the desktop image of the virtual machine through the display service of the host system, and displaying the desktop image of the virtual machine on the display screen based on the first display card.

According to another aspect of the present invention, there is provided a desktop image display method applied to a host system of a terminal device, the method including:

after the host system is started, starting a virtual machine system, and rendering the virtual machine system based on a second display card to obtain a virtual machine desktop image; the second display card is directly communicated with the virtual machine system;

acquiring a virtual machine desktop image of the virtual machine system through a display service of the host system;

and when the display service acquires the desktop data of the virtual machine, displaying the desktop image of the virtual machine on the display screen based on a first display card.

According to another aspect of the present invention, there is provided a desktop image display method applied to a virtual machine system of a terminal device, the method including:

after the virtual machine system is started, a virtual screen is created, and a virtual machine desktop image is obtained on the virtual screen based on rendering of a second display card; the second display card is directly communicated with the virtual machine system;

acquiring a virtual machine desktop image of a virtual screen based on the refreshing frequency of the virtual screen through a screen sharing service of the virtual machine system;

the virtual machine desktop image is sent to a host system through a screen sharing service of the virtual machine system, so that the host system displays the virtual machine desktop image on a display screen of the host system based on a first display card.

According to another aspect of the present invention, there is provided a desktop image display apparatus integrated in a terminal device system, the apparatus including:

the host computer starting module is used for starting the host computer system and isolating the second display card, so that the host computer system outputs a host computer desktop image based on the first display card and displays the host computer desktop image on the display screen; the second display card is directly communicated with the virtual machine system;

the virtual machine starting module is used for starting a virtual machine system through the host system so as to enable the virtual machine system to render a virtual machine desktop image based on the second display card;

and the desktop display module is used for acquiring the virtual machine desktop image through the display service of the host system and displaying the virtual machine desktop image on the display screen based on the first display card.

According to another aspect of the present invention, there is provided a desktop image display apparatus integrated with a host system of a terminal device, the apparatus including:

the virtual machine starting module is used for starting the virtual machine system after the host system is started, so that the virtual machine system obtains a virtual machine desktop image through rendering based on the second display card; the second display card is directly communicated with the virtual machine system;

the virtual image acquisition module is used for acquiring a virtual machine desktop image of the virtual machine system through a display service of the host system;

and the virtual image display module is used for displaying the virtual machine desktop image on the display screen based on the first display card when the display service acquires the virtual machine desktop data.

According to another aspect of the present invention, there is provided a desktop image display apparatus integrated in a virtual machine system of a terminal device, the apparatus including:

the virtual image rendering module is used for creating a virtual screen after the virtual machine system is started, and rendering on the virtual screen based on a second display card to obtain a virtual machine desktop image; the second display card is directly communicated with the virtual machine system;

the virtual image acquisition module is used for acquiring a virtual machine desktop image of a virtual screen based on the refreshing frequency of the virtual screen through a screen sharing service of the virtual machine system;

the virtual image sending module is used for sending the virtual machine desktop image to a host system through the screen sharing service of the virtual machine system, so that the host system displays the virtual machine desktop image on a display screen of the host system based on a first display card.

According to another aspect of the present invention, there is provided a terminal device including:

the display device comprises a first display card, a second display card, a display screen, at least one processor and a memory which is connected with the at least one processor in a communication mode; the terminal equipment is provided with a host system and at least one virtual machine system; the host system is directly connected with the first display card, and the virtual machine system is directly connected with the second display card;

wherein the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the desktop image display method according to any of the embodiments of the present invention.

According to another aspect of the present invention, there is provided a computer-readable storage medium storing computer instructions for causing a processor to implement a desktop image display method according to any one of the embodiments of the present invention when the computer instructions are executed.

According to the technical scheme of the embodiment of the invention, the host system is started and the second display card is isolated, so that the host system outputs the host desktop image based on the first display card and displays the host desktop image on the display screen, and the second display card is directly communicated with the virtual machine system; starting the virtual machine system through the host system so that the virtual machine system obtains a virtual machine desktop image based on rendering of the second display card; the method has the advantages that the desktop images of the virtual machines are acquired through the display service of the host system, the desktop images of the virtual machines are displayed on the display screen based on the first display card, the problem that the virtual machine systems such as games or entertainment are independently connected with the display card and one display screen needs to be additionally configured to display the desktop images of the virtual machine systems is solved, the desktop images of the virtual machine systems which are independently connected with the display card are displayed on the display screen of the host system, the number of the display screens is reduced, the cost is effectively reduced, the method can be expanded to the scenes of a plurality of virtual machine systems, and the method has good expandability.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a flowchart of a desktop image display method according to an embodiment of the present invention;

FIG. 2 is a flowchart of a desktop image display method according to a second embodiment of the present invention;

fig. 3 is an architecture diagram of a terminal device to which a desktop image display method is applied according to a specific example;

FIG. 4 is a flow chart of a desktop image display method of a specific example;

FIG. 5 is a flowchart of a desktop image display method according to a third embodiment of the present invention;

fig. 6 is a flowchart of a desktop image display method according to a fourth embodiment of the present invention;

fig. 7 is a schematic structural diagram of a desktop image display device according to a fifth embodiment of the present invention;

fig. 8 is a schematic structural diagram of a desktop image display device according to a sixth embodiment of the present invention;

fig. 9 is a schematic structural diagram of a desktop image display device according to a seventh embodiment of the present invention;

fig. 10 is a schematic structural diagram of a terminal device implementing the desktop image display method according to the embodiment of the present invention.

Detailed Description

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example one

Fig. 1 is a flowchart of an embodiment of the present invention, which provides a desktop image display method, where this embodiment may be applicable to a situation where a desktop image of a host system and/or a virtual machine system is displayed, and the method may be executed by a desktop image display apparatus, where the desktop image display apparatus may be implemented in a form of hardware and/or software, and the desktop image display apparatus may be configured in a terminal device, and the terminal device may be a device such as a computer or a vehicle-mounted host.

The terminal equipment comprises a first display card, a second display card, a display screen, at least one processor and a memory which is connected with the at least one processor in a communication mode; the terminal equipment is provided with a host system and at least one virtual machine system; the host system is directly connected with the first display card, and the virtual machine system is directly connected with the second display card; the host system outputs a host desktop image based on the first display card, and the virtual machine system renders the host desktop image based on the second display card to obtain a virtual machine desktop image; the second display card is directly communicated with the virtual machine system; the first display card is externally connected with a display screen, and the first display card is not externally connected with the display screen. Illustratively, the first graphics card may be an integrated graphics card and the second graphics card may be a stand-alone graphics card. As shown in fig. 1, the method includes:

and S110, starting the host system and isolating the second display card, so that the host system outputs a host desktop image based on the first display card and displays the host desktop image on a display screen, wherein the second display card is directly communicated with the virtual machine system.

Specifically, a host system in the terminal device is started and the second display card is isolated, after the host system is started, the host desktop image can be output based on the first display card, and the host desktop image is displayed on a display screen externally connected with the first display card; but the second display card can not be used for outputting the desktop image of the host, so that the second display card is ensured to be unoccupied, and the second display card can undertake the task of outputting the desktop image of the virtual machine system.

For example, the starting of the host system in the terminal device may be automatic starting of the host system after the terminal device is powered on, or may be based on a starting instruction triggered by a response user.

And S120, starting the virtual machine system through the host system so that the virtual machine system obtains a virtual machine desktop image based on rendering of the second display card.

Specifically, the host system starts the virtual machine system, the virtual machine system is directly connected with the second display card through configuration, and after the virtual machine system is started, the desktop image of the virtual machine system is output through the second display card. Because the second display card is directly communicated with the virtual machine system, the virtual machine system can independently use one display card, so that better rendering capability can be ensured, and the user experience is improved. However, since the second display card is not externally connected to the display screen, only the first display card is externally connected to the display screen, and therefore, the virtual machine system needs to send the desktop image of the virtual machine system to the first display card for image display.

For example, the virtual machine system may be a gaming virtual machine system or other entertainment virtual machine system.

S130, the virtual machine desktop image is obtained through the display service of the host system, and the virtual machine desktop image is displayed on the display screen based on the first display card.

Specifically, the display service of the host system may be a display service program stored in the host system, and is configured to obtain the desktop image of the virtual machine and send the desktop image to the first display card, so that the first display card displays the desktop image of the virtual machine on a display screen externally connected to the first display card.

For example, the display service of the host system may be automatically started after the host system is started, wait for receiving the virtual machine desktop image sent by the virtual machine system, or periodically obtain the virtual machine desktop image, or obtain the virtual machine desktop image when receiving the display notification of the virtual machine system.

It can be understood that, in the embodiment of the present invention, the desktop images of the host system and/or the virtual machine system may be displayed on the display screen externally connected to the first display card, and may also be expanded to multiple virtual machine scenes, and the desktop images of multiple virtual machine systems are displayed at the same time, so that the present invention has good extensibility.

In the embodiment of the invention, the virtual machine system and the host system respectively render and output the desktop images based on different display cards, and the desktop images of the virtual machine system are displayed on the display screen externally connected with the host system, so that the virtual machine system does not need to be additionally connected with one display screen, the number of the display screens is reduced, and the cost is effectively reduced. Especially for the field with limited space such as a vehicle-mounted cabin, the user experience is improved, and meanwhile, the space and the cost are greatly saved.

According to the technical scheme of the embodiment of the invention, the host system is started and the second display card is isolated, so that the host system outputs the host desktop image based on the first display card and displays the host desktop image on the display screen, and the second display card is directly communicated with the virtual machine system; starting the virtual machine system through the host system so that the virtual machine system obtains a virtual machine desktop image based on rendering of the second display card; the virtual machine desktop image is obtained through the display service of the host system, and the virtual machine desktop image is displayed on the display screen based on the first display card, so that the problems that the virtual machine systems such as games or entertainment are independently connected with the display card and a display screen is additionally configured to display the desktop image of the virtual machine system are solved, the desktop image of the virtual machine system which is independently connected with the display card is displayed on the display screen of the host system, the number of the display screens is reduced, the cost is effectively reduced, the scene of a plurality of virtual machine systems can be expanded, and the virtual machine desktop image display system has good expandability.

Optionally, the display screen is divided into a plurality of display areas, and each display area is used for displaying a desktop image of the host system or a desktop image of a virtual machine system of any virtual machine system.

Specifically, the display screen is divided into a plurality of display areas, each display area can be used for displaying a host system desktop image or a virtual machine system desktop image of any virtual machine system, and the host system desktop image or a desktop of a certain virtual machine is switched according to a switching instruction, so that the host system and the virtual machine system can be simultaneously displayed on the display screen, or one or more virtual machine system desktop images are displayed, or one or more host system desktop images are displayed.

Example two

Fig. 2 is a flowchart of a desktop image display method according to a second embodiment of the present invention, where on the basis of the foregoing embodiment, the present embodiment further includes, before acquiring a desktop image of a virtual machine through a display service of a host system, a technical feature of: establishing a data channel between the virtual machine system and the host system, and enabling the virtual machine system and the host system to transmit a virtual machine desktop image through the data channel; and starting the display service through the host system, enabling the display service of the host system to enter a data acquisition waiting state, and waiting for acquiring the virtual machine desktop image output by the virtual machine system based on the second display card. ".

As shown in fig. 2, the method includes:

s210, starting the host system and isolating the second display card, so that the host system outputs a host desktop image based on the first display card and displays the host desktop image on a display screen; the second display card is directly communicated with the virtual machine system.

And S220, starting the virtual machine system through the host system so that the virtual machine system obtains a virtual machine desktop image based on the rendering of the second display card.

And S230, creating a data channel between the virtual machine system and the host system, so that the virtual machine system and the host system transmit the desktop image of the virtual machine through the data channel.

Specifically, a data channel is created between the virtual machine system and the host system, and the virtual machine desktop image output by the virtual machine system based on the second graphics card can be transmitted to the display service of the host system through the data channel.

The data channel may be a communication network based on a preset communication Protocol, such as ethernet, Wireless Local Area Network (WLAN), hypertext Transfer Protocol (http), or other communication protocols, created between the virtual machine system and the host system; may also include: the system comprises a control instruction channel and a shared memory, wherein the control instruction channel is used for transmitting control instructions such as display notifications and the like, and the shared memory is a part of physical memory shared by a plurality of processes or systems and is used for storing and sharing a virtual machine desktop image sent by a virtual machine system for being acquired by a host system. The data channel may also be a buffer or a buffer queue, etc.

It should be noted that step S230 does not have to be executed after steps S210 and S220, and only needs to complete the establishment of the data channel between the virtual machine system and the host system before the display service of the host system obtains the virtual machine desktop image in step S240, so that the display service of the host system can obtain the virtual machine desktop image through the data channel.

S240, acquiring the desktop image of the virtual machine through the display service of the host system, and displaying the desktop image of the virtual machine on a display screen based on the first display card.

Specifically, the virtual machine desktop image is obtained based on a data channel between the virtual machine system and the host system through a display service of the host system.

According to the technical scheme of the embodiment of the invention, the host system is started and the second display card is isolated, so that the host system outputs the host desktop image based on the first display card and displays the host desktop image on the display screen, and the second display card is directly communicated with the virtual machine system; starting the virtual machine system through the host system so that the virtual machine system obtains a virtual machine desktop image based on rendering of the second display card; establishing a data channel between the virtual machine system and the host system, and enabling the virtual machine system and the host system to transmit a virtual machine desktop image through the data channel; starting a display service through the host system, enabling the display service of the host system to enter a data acquisition waiting state, and waiting for acquiring a virtual machine desktop image output by the virtual machine system based on the second display card; the virtual machine desktop image is obtained through the display service of the host system, and the virtual machine desktop image is displayed on the display screen based on the first display card, so that the problems that the virtual machine systems such as games or entertainment are independently connected with the display card and a display screen is additionally configured to display the desktop image of the virtual machine system are solved, the desktop image of the virtual machine system which is independently connected with the display card is displayed on the display screen of the host system, the number of the display screens is reduced, the cost is effectively reduced, the scene of a plurality of virtual machine systems can be expanded, and the virtual machine desktop image display system has good expandability.

Optionally, after the host system is started, before the virtual machine desktop image is acquired through the display service of the host system, the method further includes:

and if the display service of the host system is not in the started state, starting the display service through the host system, enabling the display service to enter a data acquisition waiting state, and waiting for acquiring the virtual machine desktop image output by the virtual machine system based on the second display card.

Specifically, the display service of the host system may be automatically started after the host system is started. If the display service is not started after the host system is started, the host system can start the display service, so that the display service enters a state waiting for acquiring data and waits for acquiring a virtual machine desktop image rendered by the virtual machine system through a second display card connected with the virtual machine desktop image through a data channel.

It should be noted that the step in which the host system can start the display service can be executed at any time after the host system is started and between the step in which the display service of the host system acquires the desktop image of the virtual machine and the step in which the display service of the host system acquires the desktop image of the virtual machine, and the start is completed only before the display service of the host system acquires the desktop image of the virtual machine.

Optionally, after the virtual machine system is started by the host system, before the virtual machine desktop image is acquired by the display service of the host system, the method further includes:

creating a virtual screen through a virtual machine system, and rendering on the virtual screen based on a second display card to obtain a virtual machine desktop image;

through the screen sharing service of the virtual machine system, the virtual machine desktop image of the virtual screen is obtained based on the refreshing frequency of the virtual screen, and the virtual machine desktop image is sent to the host system through the data channel.

The screen sharing service is used for acquiring a virtual machine desktop image from a second display card connected with the virtual machine system and sending the virtual machine desktop image to the host system.

Specifically, after the virtual machine system is started, a virtual screen is created and rendered on the virtual screen based on the second display card to obtain a virtual machine desktop image, the virtual machine desktop image of the virtual screen is periodically obtained through the screen sharing service based on the refreshing frequency of the virtual screen, and the virtual machine desktop image is sent to the host system through the data channel.

In one embodiment, the data channel includes: a communication network based on a preset communication protocol; obtaining a virtual machine desktop image through a display service of a host system, comprising:

coding the desktop image of the virtual machine into a target desktop image of the virtual machine through a screen sharing service of the virtual machine system, wherein the target desktop image of the virtual machine is an image which accords with a preset communication protocol;

sending the desktop image of the target virtual machine to a display service of a host system through a communication network based on a preset communication protocol;

and receiving the target virtual machine desktop image through the display service of the host system, and decoding the target virtual machine desktop image to obtain the virtual machine desktop image.

The communication system network based on the preset communication Protocol may be an ethernet, a Wireless Local Area Network (WLAN), a hypertext Transfer Protocol (http), and the like, which is not limited in this embodiment of the present invention.

Specifically, if a data channel created between the host system and the virtual machine system is a communication system network based on a preset communication protocol, the screen sharing service of the virtual machine system needs to encode the virtual machine desktop image into a target virtual machine desktop image conforming to the preset communication protocol, and send the target virtual machine desktop image to the display service of the host system through the communication network based on the preset communication protocol. After receiving the target virtual machine desktop image sent by the virtual machine system, the display service of the host system decodes the virtual machine desktop image from the target virtual machine desktop image, so that the virtual machine system transmits the virtual machine desktop image to the host system through a data channel.

In another embodiment, the data channel includes: a control instruction channel and a shared memory between the virtual machine system and the host system; obtaining a virtual machine desktop image through a display service of a host system, comprising:

writing the desktop image of the virtual machine into a shared memory through a screen sharing service of the virtual machine system, and sending a display notification to a host system based on a control instruction channel;

and if the display service of the host system receives the display notification, reading the desktop image of the virtual machine from the shared memory through the display service of the host system.

Specifically, if the data channel created between the host system and the virtual machine system is the control instruction channel and the shared memory, the screen sharing service of the virtual machine system writes the virtual machine desktop image into the shared memory, and sends a display notification to the host system through the control instruction channel, and after receiving the display notification, the display service of the host system reads the virtual machine desktop image of the virtual machine system from the shared memory, so that the virtual machine system transmits the virtual machine desktop image to the host system through the data channel.

In a specific example, fig. 3 is an architecture diagram of a terminal device application applying the desktop image display method of the specific example. The terminal equipment can adopt a chip scheme of an AMD platform, a host system is loaded with a stable ubuntu software version and is configured with an integrated display card (namely a first display card) and an independent display card (namely a second display card), the integrated display card is provided with an external display screen, the independent display card is not provided with the external display screen, and the host system is normally started after the terminal equipment is powered on.

Fig. 4 is a flowchart of a method for displaying a desktop image using the terminal device shown in fig. 3. As shown in fig. 3 and 4, the terminal device starts the host system, isolates the independent graphics card connected to the virtual machine system, so that the host system can only output the host desktop image based on the integrated graphics card, and displays the host desktop image on the display screen; creating a data channel between the host system and the virtual machine, the data channel comprising: sharing memory and control channels. The host system starts the display service to enable the display service to enter a state of waiting for notification of the virtual machine system, and during the period of starting the display service, the host system can also start the virtual machine system, create a virtual screen through configuration, and render and output a desktop image of the virtual machine on the virtual screen based on the independent display card; and starting the screen sharing service, acquiring a virtual machine desktop image through the screen sharing service, writing the virtual machine desktop image into the shared memory, and sending a display notice to a display service of the host system through the control instruction channel. After receiving the display notification, the display service of the host system acquires the desktop image of the virtual machine from the shared memory, and the integrated display card connected based on the host system displays the desktop image of the virtual machine on the display screen externally connected with the host system, so that the desktop image of the virtual machine system is displayed on the display screen externally connected with the host system, the virtual machine system does not need to be additionally connected with one display screen, the number of the display screens is reduced, and the cost is effectively reduced

EXAMPLE III

Fig. 5 is a flowchart of a desktop image display method according to a third embodiment of the present invention, where the method is applicable to a case of displaying a desktop image of a host system and/or a virtual machine system, and the method may be executed by a desktop image display apparatus, where the desktop image display apparatus may be implemented in a form of hardware and/or software, the desktop image display apparatus may be configured in a host system of a terminal device, and the terminal device may be a device such as a computer or a vehicle-mounted host.

As shown in fig. 5, the method includes:

and S310, after the host system is started, starting the virtual machine system, and rendering the virtual machine system based on the second display card to obtain a virtual machine desktop image.

The virtual machine system is independently connected with the second display card, and the second display card bears the image rendering output task of the virtual machine system.

Specifically, after the host system is started, the virtual machine system may be automatically started, so that the virtual machine system may render the virtual machine desktop image based on the second graphics card, and send the virtual machine desktop image to the host system.

S320, acquiring a virtual machine desktop image of the virtual machine system through the display service of the host system.

Specifically, after the host system is started, the virtual machine desktop image of the virtual machine system may be acquired according to the built-in display service. After the host system is started, if the display service is not started, the display service can be started, and after the display service is started, the display service can enter a state of waiting for acquiring data and wait for acquiring a virtual machine desktop image of the virtual machine system.

For example, the display service may acquire the virtual machine desktop image of the virtual machine system by receiving the virtual machine desktop image sent by the virtual machine system, or by receiving a display notification sent by the virtual machine system, acquiring the virtual machine desktop image of the virtual machine system.

S330, when the display service acquires the desktop data of the virtual machine, displaying the desktop image of the virtual machine on a display screen based on the first display card.

Specifically, the display service of the host system displays the virtual machine desktop image sent by the virtual machine system on the display screen based on the first display card, so that the virtual machine system desktop image output by the second display card based on the direct virtual machine system is displayed on the display screen externally connected to the first display card of the host system, the virtual machine system does not need to be additionally connected with a display screen, the number of the display screens is reduced, and the cost is effectively reduced.

According to the technical scheme provided by the embodiment of the invention, after the host system is started, the virtual machine system is started, so that the virtual machine system obtains the desktop image of the virtual machine based on the rendering of the second display card, and the second display card is directly communicated with the virtual machine system; starting a display service of a host system to enable the display service to acquire a virtual machine desktop image of a virtual machine system; when the display service acquires the desktop data of the virtual machine, the desktop image of the virtual machine is displayed on the display screen based on the first display card, the problem that the virtual machine systems such as games or entertainment and the like are independently connected with the display card and an additional display screen is required to be configured to display the desktop image of the virtual machine system is solved, the desktop image of the virtual machine system which is independently connected with the display card is displayed on the display screen of the host system, the number of the display screens is reduced, the cost is effectively reduced, the scene of a plurality of virtual machine systems can be expanded, and the display service has good expandability.

Optionally, after the host system is started, the method further includes: and outputting the host desktop image based on the first display card, and displaying the host desktop image on the display screen.

The first display card takes charge of the image output task of the host system.

Specifically, after the host system is started, the host desktop data can be output based on the first display card, and the host desktop image is displayed on the external display screen, so that the desktop image of the host system and/or the desktop image of the virtual machine system are displayed on the same display screen, and a display screen does not need to be additionally configured for the virtual machine system directly connected with the second display card.

Example four

Fig. 6 is a flowchart of a desktop image display method according to a fourth embodiment of the present invention, where the method is applicable to a case of displaying a desktop image of a host system and/or a virtual machine system, and the method may be executed by a desktop image display device, where the desktop image display device may be implemented in a form of hardware and/or software, the desktop image display device may be configured in a virtual machine system of a terminal device, and the terminal device may be a computer or a vehicle-mounted host.

As shown in fig. 6, the method includes:

s410, after the virtual machine system is started, creating a virtual screen, and rendering on the virtual screen based on a second display card to obtain a virtual machine desktop image; the second display card is directly communicated with the virtual machine system.

Specifically, the virtual machine system may create a virtual screen after being started, and a virtual machine desktop image may be rendered based on a second graphics card of the direct virtual machine system through the virtual screen. Because the second display card is directly connected with the virtual machine system, the virtual machine system can independently use one display card, so that better rendering capability can be ensured, and the user experience is improved.

S420, acquiring a virtual machine desktop image of the virtual screen based on the refreshing frequency of the virtual screen through a screen sharing service of the virtual machine system.

Specifically, after the virtual machine system is started, a virtual screen is created, and a virtual machine desktop image is obtained on the virtual screen by rendering based on a second display card of the direct virtual machine system;

s430, sending the virtual machine desktop image to the host system through the screen sharing service of the virtual machine system, so that the host system displays the virtual machine desktop image on the display screen of the host system based on the first display card.

Specifically, the screen sharing service sends the virtual machine desktop image to the host system, so that the host system displays the virtual machine desktop image on the display screen based on the first display card, the virtual machine system desktop image output by the second display card based on the direct virtual machine system is displayed on the display screen externally connected to the first display card of the host system, the virtual machine system does not need to be additionally connected with a display screen, the number of the display screens is reduced, and the cost is effectively reduced.

Specifically, after the virtual machine system is started, the virtual machine desktop image of the virtual screen can be acquired through the screen sharing service based on the refresh frequency of the virtual screen, and the virtual machine desktop image is sent to the host system, so that the host system displays the virtual machine desktop image on the display screen.

According to the technical scheme provided by the embodiment of the invention, the virtual screen is created after the virtual machine system is started, the virtual screen is rendered based on the second display card to obtain the desktop image of the virtual machine, and the second display card is directly communicated with the virtual machine system; acquiring a virtual machine desktop image of a virtual screen based on the refreshing frequency of the virtual screen through a screen sharing service of a virtual machine system; the screen sharing service through the virtual machine system sends the desktop image of the virtual machine to the host system, so that the host system displays the desktop image of the virtual machine on the display screen of the host system based on the first display card, the problem that the desktop image of the virtual machine system of a game or entertainment system is required to be additionally configured with one display screen to display the desktop image of the virtual machine system can be solved, the desktop image of the virtual machine system which is independently connected with the display card is displayed on the display screen of the host system, the number of the display screens is reduced, the cost is effectively reduced, the scene of a plurality of virtual machine systems can be expanded, and the expandability is good.

Optionally, after the virtual machine system is started and before the virtual machine desktop image of the virtual screen is acquired based on the refresh frequency of the virtual screen by the screen sharing service of the virtual machine system, the method further includes:

if the screen sharing service of the virtual machine system is not started, starting the screen sharing service through the virtual machine system, and enabling the screen sharing service to obtain a virtual machine desktop image of the virtual screen based on the refreshing frequency of the virtual screen.

Specifically, the screen sharing service can be started at the same time when the virtual machine system is started, and if the screen sharing service is not started after the virtual machine system is started, the screen sharing service can be started through the virtual machine system, so that the screen sharing service can acquire the virtual machine desktop image of the virtual screen based on the refreshing frequency of the virtual screen.

EXAMPLE five

Fig. 7 is a schematic structural diagram of a desktop image display apparatus according to a fifth embodiment of the present invention, where the apparatus may be integrated in a terminal device. As shown in fig. 7, the apparatus includes: a host start module 510, a virtual machine start module 520, and a desktop display module 530;

the host starting module 510 is configured to start a host system and isolate a second graphics card, so that the host system outputs a host desktop image based on the first graphics card and displays the host desktop image on a display screen; the second display card is directly communicated with the virtual machine system;

a virtual machine starting module 520, configured to start a virtual machine system through the host system, so that the virtual machine system obtains a virtual machine desktop image based on the rendering of the second graphics card;

a desktop display module 530, configured to obtain the virtual machine desktop image through a display service of the host system, and display the virtual machine desktop image on the display screen based on the first display card.

Optionally, the method further includes:

and the display service starting module is used for starting the display service through the host system after the host system is started and before the virtual machine desktop image is obtained through the display service of the host system, enabling the display service to enter a data obtaining waiting state if the display service of the host system is not started, and waiting for obtaining the virtual machine desktop image output by the virtual machine system based on the second display card.

Optionally, the method further includes:

a data channel creating module, configured to create a data channel between the virtual machine system and the host system before the virtual machine desktop image is obtained through the display service of the host system, so that the virtual machine system and the host system transmit the virtual machine desktop image through the data channel.

Optionally, the method further includes:

a virtual screen creating module, configured to create a virtual screen through the virtual machine system after the virtual machine system is started through the host system and before the virtual machine desktop image is acquired through a display service of the host system, and render the virtual screen based on a second display card to obtain a virtual machine desktop image, where the second display card is directly connected to the virtual machine system;

and the virtual image sending module is used for acquiring a virtual machine desktop image of the virtual screen based on the refreshing frequency of the virtual screen through the screen sharing service of the virtual machine system, and sending the virtual machine desktop image to the host system through the data channel.

Optionally, the data channel includes: a communication network based on a preset communication protocol; the desktop display module 530 includes:

coding the virtual machine desktop image into a target virtual machine desktop image through a screen sharing service of the virtual machine system, wherein the target virtual machine desktop image is an image conforming to a preset communication protocol;

sending the target virtual machine desktop image to a display service of the host system through the communication network based on the preset communication protocol;

and receiving the target virtual machine desktop image through the display service of the host system, and decoding the target virtual machine desktop image to obtain the virtual machine desktop image.

Optionally, the data channel includes: a control instruction channel and a shared memory between the virtual machine system and the host system; the desktop display module 530 includes:

writing the virtual machine desktop image into a shared memory through a screen sharing service of the virtual machine system, and sending a display notification to the host system based on the control instruction channel;

and if the display service of the host system receives the display notification, reading the desktop image of the virtual machine from the shared memory through the display service of the host system.

Optionally, the display screen is divided into a plurality of display areas, and each display area is used for displaying a desktop image of the host system or a desktop image of a virtual machine system of any virtual machine system.

The desktop image display device provided by the embodiment of the invention can execute the desktop image display method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

EXAMPLE six

Fig. 8 is a schematic structural diagram of a desktop image display apparatus according to a sixth embodiment of the present invention, where the apparatus may be integrated in a host system of a terminal device. As shown in fig. 8, the apparatus includes: a virtual machine starting module 610, an image obtaining module 620 and a desktop display module 530;

the virtual machine starting module 610 is configured to start a virtual machine system after the host system is started, so that the virtual machine system obtains a virtual machine desktop image through rendering based on a second graphics card; the second line display card is directly communicated with the virtual machine system;

a virtual image obtaining module 620, configured to obtain a virtual machine desktop image of the virtual machine system through a display service of the host system;

the virtual image display module 630 is configured to display the virtual machine desktop image on the display screen based on the first display card when the display service acquires the virtual machine desktop data.

The desktop image display device provided by the embodiment of the invention can execute the desktop image display method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

EXAMPLE seven

Fig. 9 is a schematic structural diagram of a desktop image display apparatus according to a seventh embodiment of the present invention, where the apparatus may be integrated in a virtual machine system of a terminal device. As shown in fig. 9, the apparatus includes: a virtual image rendering module 710, a virtual image obtaining module 720 and a virtual image sending module 730;

the virtual image rendering module 710 is configured to create a virtual screen after the virtual machine system is started, and render a virtual machine desktop image on the virtual screen based on a second video card;

a virtual image obtaining module 720, configured to obtain, by a screen sharing service of the virtual machine system, a virtual machine desktop image of a virtual screen based on a refresh frequency of the virtual screen;

the virtual image sending module 730 is configured to send the virtual machine desktop image to a host system through a screen sharing service of the virtual machine system, so that the host system displays the virtual machine desktop image on a display screen of the host system based on a first display card.

The desktop image display device provided by the embodiment of the invention can execute the desktop image display method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example eight

Fig. 10 shows a schematic structural diagram of a terminal device 10 that may be used to implement an embodiment of the invention. Terminal devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The terminal device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.

As shown in fig. 10, the terminal device 10 includes: the first and second video cards 20 and 21, the display screen (included in the output unit 17), the at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM)12, a Random Access Memory (RAM)13, and the like, wherein the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM)12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data necessary for the operation of the terminal device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14. The terminal equipment is provided with a host system and at least one virtual machine system, the host system is directly connected with the first display card, and the virtual machine system is directly connected with the second display card.

A plurality of components in the terminal device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, or the like; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the terminal device 10 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, or the like. The processor 11 performs the various methods and processes described above, such as a desktop image display method.

In some embodiments, the desktop image display method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed on the terminal device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the desktop image display method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the desktop image display method by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

A computer program for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on a machine, as a stand-alone software package partly on a machine and partly on a remote machine or entirely on a remote machine or server.

In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here may be implemented on a terminal device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the terminal device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), blockchain networks, and the internet.

The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solution of the present invention can be achieved.

The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (14)

1. A desktop image display method is applied to a terminal device, and comprises the following steps:

starting a host system and isolating a second display card, so that the host system outputs a host desktop image based on a first display card and displays the host desktop image on a display screen; the second display card is directly communicated with the virtual machine system;

starting a virtual machine system through the host system so that the virtual machine system obtains a virtual machine desktop image based on the second display card rendering;

and acquiring the desktop image of the virtual machine through the display service of the host system, and displaying the desktop image of the virtual machine on the display screen based on the first display card.

2. The method of claim 1, further comprising, after the booting the host system and before the obtaining the virtual machine desktop image by the display service of the host system:

and if the display service of the host system is not in an opened state, starting the display service through the host system, enabling the display service to enter a data acquisition waiting state, and waiting for acquiring the virtual machine desktop image output by the virtual machine system based on the second display card.

3. The method of claim 1, further comprising, prior to the obtaining, by a display service of the host system, the virtual machine desktop image:

and creating a data channel between the virtual machine system and the host system, and enabling the virtual machine system and the host system to transmit the virtual machine desktop image through the data channel.

4. The method of claim 3, further comprising, after the booting of the virtual machine system by the host system and before the obtaining of the virtual machine desktop image by the display service of the host system:

creating a virtual screen through the virtual machine system, and rendering on the virtual screen based on the second display card to obtain a virtual machine desktop image;

through the screen sharing service of the virtual machine system, the virtual machine desktop image of the virtual screen is obtained based on the refreshing frequency of the virtual screen, and the virtual machine desktop image is sent to the host system through the data channel.

5. The method of claim 4, wherein the data channel comprises: a communication network based on a preset communication protocol; the obtaining the virtual machine desktop image through the display service of the host system includes:

coding the virtual machine desktop image into a target virtual machine desktop image through a screen sharing service of the virtual machine system, wherein the target virtual machine desktop image is an image conforming to a preset communication protocol;

sending the target virtual machine desktop image to a display service of the host system through the communication network based on the preset communication protocol;

and receiving the target virtual machine desktop image through the display service of the host system, and decoding the target virtual machine desktop image to obtain the virtual machine desktop image.

6. The method of claim 4, wherein the data channel comprises: a control instruction channel and a shared memory between the virtual machine system and the host system; the obtaining the virtual machine desktop image through the display service of the host system includes:

writing the virtual machine desktop image into a shared memory through a screen sharing service of the virtual machine system, and sending a display notification to the host system based on the control instruction channel;

and if the display service of the host system receives the display notification, reading the desktop image of the virtual machine from the shared memory through the display service of the host system.

7. The method of claim 1, further comprising:

the display screen is divided into a plurality of display areas, and each display area is used for displaying a desktop image of a host system or a desktop image of a virtual machine system of any virtual machine system.

8. A desktop image display method is applied to a host system of a terminal device, and the method comprises the following steps:

after the host system is started, starting a virtual machine system, and rendering the virtual machine system based on a second display card to obtain a virtual machine desktop image; the second display card is directly communicated with the virtual machine system;

acquiring a virtual machine desktop image of the virtual machine system through a display service of the host system;

and when the display service acquires the desktop data of the virtual machine, displaying the desktop image of the virtual machine on the display screen based on a first display card.

9. A desktop image display method is applied to a virtual machine system of a terminal device, and the method comprises the following steps:

after the virtual machine system is started, a virtual screen is created, and a virtual machine desktop image is obtained on the virtual screen based on rendering of a second display card; the second display card is directly communicated with the virtual machine system;

acquiring a virtual machine desktop image of a virtual screen based on the refreshing frequency of the virtual screen through a screen sharing service of the virtual machine system;

and sending the virtual machine desktop image to a host system through a screen sharing service of the virtual machine system, so that the host system displays the virtual machine desktop image on a display screen of the host system based on a first display card.

10. A desktop image display apparatus, integrated in a terminal device, the apparatus comprising:

the host computer starting module is used for starting the host computer system and isolating the second display card, so that the host computer system outputs a host computer desktop image based on the first display card and displays the host computer desktop image on the display screen; the second display card is directly communicated with the virtual machine system;

the virtual machine starting module is used for starting a virtual machine system through the host system so as to render the virtual machine system to obtain a virtual machine desktop image based on the second display card;

and the desktop display module is used for acquiring the virtual machine desktop image through the display service of the host system and displaying the virtual machine desktop image on the display screen based on the first display card.

11. A desktop image display apparatus integrated with a host system of a terminal device, the apparatus comprising:

the virtual machine starting module is used for starting the virtual machine system after the host system is started, so that the virtual machine system obtains a virtual machine desktop image through rendering based on the second display card;

the virtual image acquisition module is used for acquiring a virtual machine desktop image of the virtual machine system through a display service of the host system;

and the virtual image display module is used for displaying the virtual machine desktop image on the display screen based on the first display card when the display service acquires the virtual machine desktop data.

12. A desktop image display apparatus, wherein the apparatus is integrated in a virtual machine system of a terminal device, the apparatus comprising:

the virtual image rendering module is used for creating a virtual screen after the virtual machine system is started, and rendering on the virtual screen based on a second display card to obtain a virtual machine desktop image; the second display card is directly communicated with the virtual machine system;

the virtual image acquisition module is used for acquiring a virtual machine desktop image of a virtual screen based on the refreshing frequency of the virtual screen through a screen sharing service of the virtual machine system;

the virtual image sending module is used for sending the virtual machine desktop image to a host system through the screen sharing service of the virtual machine system, so that the host system displays the virtual machine desktop image on a display screen of the host system based on a first display card.

13. A terminal device, comprising: the display device comprises a first display card, a second display card, a display screen, at least one processor and a memory which is connected with the at least one processor in a communication mode; the terminal equipment is provided with a host system and at least one virtual machine system; the host system is directly connected with the first display card, and the virtual machine system is directly connected with the second display card;

wherein the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the desktop image display method of any one of claims 1-9.

14. A computer-readable storage medium storing computer instructions for causing a processor to implement the desktop image display method of any one of claims 1-9 when executed.

Images