CN105550045A - Method, device and system for controlling virtual input by mobile terminal - Google Patents

Abstract

The invention discloses a method, device and system for controlling virtual input by a mobile terminal. The method comprises following steps: building a connection channel between the mobile terminal and a host device, wherein the mobile terminal receives a control instruction of a user, sending the control instruction to the host device through the connection channel; providing the control instruction to a virtual operation system by the host operation system of the host device, displaying the control instruction on the virtual operation system by the virtual operation system. Through the method provided by the invention, the virtual environment of the PC is controlled on a mobile phone without depending on a keyboard and a mouse necessarily; because the mobile terminal such as the mobile phone can provide a visual and convenient touch screen operation mode and the mobile phone is not limited on the PC, the method, the device and the system of the invention are very convenient in use.

Description

Method, device and system for controlling virtual input by using mobile terminal

Technical Field

The invention relates to the technical field of communication, in particular to a method, a device and a system for controlling virtual input by using a mobile terminal.

Background

With the popularization of mobile intelligent terminals in recent years, the rapid development of mobile internet is promoted, and the mobile intelligent terminals can meet various requirements of people due to various and rich applications. But due to technical bottlenecks in some aspects, such as battery endurance, screen size, and inevitable limitations (e.g., accuracy of operation) of the user when using the mobile device, the user experience is affected. Therefore, if the operation environment of the mobile terminal can be simulated on the PC and the advantages of the PC, such as continuous power, a bright image effect of a large screen, accurate operation of a keyboard and a mouse, etc., can be fully exerted, the experience that a user cannot obtain on the mobile intelligent terminal can be greatly satisfied.

For example, for many game players, a better game experience can be achieved by porting the interface of a hand game to a larger display PC. However, it is inconvenient to control the game only through the keyboard or mouse of the PC due to the input limitation of the PC, and therefore, it is desirable to provide a more convenient control method for controlling the operation environment simulated on the PC.

Disclosure of Invention

In view of the above, the present invention has been made to provide a method, apparatus and system for controlling virtual input using a mobile terminal that overcome or at least partially solve the above-mentioned problems. According to an aspect of the present invention, there is provided a method for controlling virtual input by using a mobile terminal, for controlling a virtual operating system hosted by a host operating system by using the mobile terminal as an operating handle, wherein the host operating system runs on a host device independent from the mobile terminal, the method comprising:

establishing a connection channel between the mobile terminal and the host device;

the mobile terminal receives a control command of a user and sends the control command to the host equipment through the connection channel;

and the host operating system of the host device provides the control command to the virtual operating system, and the virtual operating system displays the control command on the virtual operating system.

Preferably, the method further comprises establishing a communication connection between the host operating system and the virtual operating system.

Preferably, the establishing a communication connection between the host operating system and the virtual operating system includes:

starting the virtual operating system through a simulation control program in the host operating system;

the virtual operating system loads a predefined script through a base process, so that the IP address of the virtual operating system is provided for the host operating system, and a virtual input service process is started through the base process;

and the host operating system establishes the connection between the simulation control program and the virtual input service process according to the IP address of the virtual operating system.

Preferably, the first and second liquid crystal materials are,

the virtual operating system runs on another physical device which is independent from the physical device where the host operating system is located; or,

the virtual operating system runs on a virtual machine, wherein the virtual machine runs on a physical device where the host operating system is located, or the virtual machine runs on another physical device different from the physical device where the host operating system is located.

Preferably, the virtual machine is a VirtualBox virtual machine;

the starting of the virtual operating system by the simulation control program in the host operating system comprises: and controlling the VirtualBox virtual machine through a simulation control program in the host operating system, and starting the virtual operating system by the VirtualBox virtual machine.

Preferably, the virtual machine is a VirtualBox virtual machine;

the virtual operating system loads a predefined script through an underlying process to provide the IP address of the virtual operating system to the host operating system, comprising:

the virtual operating system loads a predefined script through an init process, runs a client extension component of the VirtualBox virtual machine, and writes an IP address of the virtual operating system into a client attribute of the VirtualBox virtual machine;

and the host operating system reads the client attribute of the VirtualBox virtual machine and acquires the IP address of the virtual operating system.

Preferably, the first and second liquid crystal materials are,

the starting of the virtual input service process through the base process comprises the following steps: starting a vinput process through an init process;

the establishing of the connection between the simulation control program and the virtual input service process includes: and at a designated port of the virtual operating system, the vinput process establishes connection with the simulation control program.

Preferably, an operating system of the same type as the virtual operating system is run on the mobile terminal; and controlling the virtual operating system parasitized on the host operating system by starting an application program on the mobile terminal, wherein the application program provides an operating handle interface.

Preferably, the host operating system comprises a Windows operating system, a Mac operating system or a Linux operating system; the virtual operating system comprises an Android operating system.

An apparatus for controlling virtual input by using a mobile terminal, the apparatus being configured to control a virtual operating system hosted by a host operating system by using the mobile terminal as an operating handle, wherein the host operating system runs on a host device independent from the mobile terminal, and the apparatus is located at a side of the mobile terminal, the apparatus comprising:

a connection channel establishing unit, configured to establish a connection channel between the mobile terminal and the host device;

and the control command processing unit is used for sending the control command of the user received by the mobile terminal to the host device through the connection channel, so that the host operating system of the host device provides the control command for the virtual operating system and displays the control command.

An apparatus for controlling virtual input by using a mobile terminal, the apparatus being configured to use the mobile terminal as an operation handle to control a virtual operating system hosted by a host operating system, wherein the host operating system runs on a host device independent from the mobile terminal, and the apparatus is located on a host device side, and the apparatus includes:

a connection channel establishing unit, configured to establish a connection channel between the host device and the mobile terminal;

a control command receiving unit, configured to receive, through the connection channel, a user control command sent by the mobile terminal;

a control command processing unit to provide the control command to the virtual operating system using a host operating system such that the control command is displayed on the virtual operating system.

Preferably, the virtual operating system further comprises a host virtual communication unit, configured to establish a communication connection between the host operating system and the virtual operating system.

Preferably, the host virtual communication unit specifically includes:

a virtual control starting subunit, configured to control a simulation control program in the host operating system to start the virtual operating system;

a virtual IP address obtaining subunit, configured to obtain an IP address of the virtual operating system;

and the virtual connection establishing subunit is used for establishing the connection between the simulation control program and the virtual input service process in the virtual operating system according to the IP address of the virtual operating system.

Preferably, the first and second liquid crystal materials are,

the virtual operating system runs on another physical device which is independent from the physical device where the host operating system is located; or,

the virtual operating system runs on a virtual machine, wherein the virtual machine runs on a physical device where the host operating system is located, or the virtual machine runs on another physical device different from the physical device where the host operating system is located.

Preferably, the virtual machine is a VirtualBox virtual machine; the virtual control starting subunit is specifically configured to control the VirtualBox virtual machine through a simulation control program in the host operating system, and start the virtual operating system by the VirtualBox virtual machine.

Preferably, the virtual machine is a VirtualBox virtual machine; the virtual IP address obtaining subunit is specifically configured to read a client attribute of the VirtualBox virtual machine, and obtain an IP address of the virtual operating system.

Preferably, the virtual connection establishing subunit is specifically configured to, at a specified port of the virtual operating system, establish a connection between the simulation control program and a vinput process of the virtual operating system.

A system for controlling virtual input by using a mobile terminal, the system being configured to control a virtual operating system hosted by a host operating system by using the mobile terminal as an operating handle, the system comprising:

the mobile terminal is used for establishing a connection channel with the host equipment, receiving a control command of a user, and sending the control command to the host equipment through the connection channel;

and the host equipment is used for providing the control command to the virtual operating system through a host operating system, and the virtual operating system displays the control command on the virtual operating system.

Preferably, the host operating system establishes a communication connection with the virtual operating system.

Preferably, the first and second liquid crystal materials are,

the host operating system is used for starting the virtual operating system through a simulation control program, establishing connection between the simulation control program and an input service process in the virtual operating system according to the acquired IP address of the virtual operating system, and sending the control command to the input service process by the simulation control program;

the virtual operating system is used for loading a predefined script through a basic process so as to provide the IP address of the virtual operating system for the host operating system, starting a virtual input service process through the basic process, receiving a control command sent by the simulation control program through the virtual input service process, and displaying the control command on the virtual operating system.

Preferably, the first and second liquid crystal materials are,

the virtual operating system runs on another physical device which is independent from the physical device where the host operating system is located; or,

the virtual operating system runs on a virtual machine, wherein the virtual machine runs on a physical device where the host operating system is located, or the virtual machine runs on another physical device different from the physical device where the host operating system is located.

Preferably, the virtual machine is a VirtualBox virtual machine;

and the host operating system controls the VirtualBox virtual machine through a simulation control program, and the VirtualBox virtual machine starts the virtual operating system.

Preferably, the virtual machine is a VirtualBox virtual machine;

the virtual operating system loads a predefined script through an init process, runs a client extension component of the VirtualBox virtual machine, and writes the IP address of the virtual operating system into the client attribute of the VirtualBox virtual machine;

and the host operating system reads the client attribute of the VirtualBox virtual machine and acquires the IP address of the virtual operating system.

Preferably, the first and second liquid crystal materials are,

the virtual operating system starts a vinput process through an init process; and establishing a connection with the simulation control program at a designated port by the vinput process.

Preferably, an operating system of the same type as the virtual operating system is run on the mobile terminal; controlling a virtual operating system hosted by a host operating system by starting an application on the mobile terminal, the application providing an operating handle interface

Preferably, the host operating system comprises a Windows operating system, a Mac operating system or a Linux operating system; the virtual operating system comprises an Android operating system.

Therefore, the method provided by the invention can be used for controlling the virtual environment of the PC on a mobile phone without depending on a keyboard and a mouse of the PC, and the mobile terminal such as the mobile phone can provide a visual and convenient touch screen operation mode, and the mobile phone is not limited on the PC and is very convenient to use. For example, for a game user, after the method of the present invention is adopted, the user can control the game on the control interface provided by the mobile phone, and simultaneously enjoy the large interface game scene provided by the PC, so that the experience is improved.

In a preferred embodiment of the present invention, the input control program running in the host operating system may obtain an IP address of the virtual operating system, and the host operating system establishes a communication connection with the virtual operating system through the IP address. For example, an image of the Android system actually running can be seen on a window displayed by a simulator of a host operating system, input control is performed on the simulator window through a mobile terminal, and the simulator sends user input data to a virtual Android environment of a PC for display. The mode adopted by the invention does not depend on the display and input control mode of the VirtualBox any more, so the mode is not influenced by the defects of the VirtualBox. The input control mode is completely customized for Android, and very smooth experience can be achieved, so that the fluency and the accuracy of input control can be effectively improved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

FIG. 1 illustrates a flow diagram of a method for controlling virtual input using a mobile terminal, according to one embodiment of the present invention;

FIG. 2 is a flowchart illustrating a method for establishing a connection between a host operating system and a virtual operating system in a method for controlling virtual input by a mobile terminal according to an embodiment of the present invention;

FIG. 3 illustrates a host operating system and virtual operating system layout according to one embodiment of the present invention;

FIG. 4 illustrates another host operating system and virtual operating system layout according to one embodiment of the invention;

FIG. 5 is a diagram illustrating a further host operating system and virtual operating system layout, according to an embodiment of the present invention;

FIG. 6 is a flowchart illustrating another method for controlling virtual input by using a mobile terminal according to an embodiment of the present invention, in which a connection between a host operating system and a virtual operating system is established;

FIG. 7 is a diagram illustrating a system configuration for controlling virtual input by a mobile terminal according to an embodiment of the present invention;

FIG. 8 is a diagram illustrating an apparatus for controlling virtual input by a mobile terminal according to an embodiment of the present invention;

fig. 9 is a schematic diagram illustrating an apparatus for controlling virtual input by using a mobile terminal according to another embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

In order to simulate the running environment of the mobile terminal on the PC, an android (android) simulator is produced. The android simulator can simulate the android mobile phone running environment on a computer, and enables a user to experience android games and applications on the computer. The more common android simulators are: android sdk and BlueStacks can run in a PC system and an apple iOS system, and a famous vmware virtual machine and a VirtualBox virtual machine can also simulate an android system, and currently, software of the simulators can run in a Windows operating system platform of microsoft corporation.

Those skilled in the art understand that operating systems fall into two categories, one being native and one being parasitic. The host operating system belongs to a native operating system, such as windows, linux and the like. In the present invention, the Host operating system is also referred to as a Host os, a Host system, or a Host side, for example, an operating system running a VirtualBox virtual machine. The virtual operating system belongs to a parasitic operating system, and is parasitic in a native operating system. In the present invention, the virtual operating system is also referred to as gusts, Gust system or Gust end, for example, an operating system running in a VirtualBox virtual machine environment, and particularly, the present invention preferably refers to an Android system running in the VirtualBox virtual machine environment. The VirtualBox is a source-opening virtual machine software, and a user can install and execute systems such as Solaris, Windows, DOS, Linux, OS/2Warp, BSD and the like on the VirtualBox to serve as a client operating system. In the present invention, the host operating system includes but is not limited to Windows operating system, Mac operating system or Linux operating system; the virtual operating system includes, but is not limited to, the Android operating system.

In order to solve the problem of inconvenient operation of a virtual operating system by using a mouse and a keyboard of a PC in the prior art, the present invention provides a method for controlling a virtual input by using a mobile terminal, which is used for controlling the virtual operating system parasitized on a host operating system by using the mobile terminal as an operating handle, wherein the host operating system runs on a host device (for example, a PC) independent from the mobile terminal, and referring to fig. 1, the method comprises:

s101: and establishing a connection channel between the mobile terminal and the host equipment.

Mobile terminals refer to portable devices such as cell phones, ipads, and other devices with display screens. Taking a mobile phone as an example, the connection between the mobile phone and the PC is established to ensure that the mobile phone and the PC can transmit information. The method for establishing the connection channel is not limited in the present invention, and may be a wireless network connection, a wired connection, as long as the two can be connected to establish communication, for example, the network connection may be established in the same network environment, or the connection between the two may be established through a dedicated application program, or the connection may be established by starting bluetooth, or the wired connection may be established through a transmission line, and so on.

S102: the mobile terminal receives a control command of a user and sends the control command to the host equipment through the connection channel.

Still taking the mobile phone as an example, the mobile phone receives a control command input by the user on the mobile phone, and then sends the control command to the PC through the connection channel.

Specifically, an application program (APP) may be specially configured on the mobile phone, and the APP is responsible for displaying a control command input interface on which a user inputs a control command. For example, for a player of a mobile phone, the application program displays an interface (for example, comprising forward and backward buttons) similar to a game operation handle, and the user inputs a control command on the interface by using a touch screen of the mobile phone.

S103: the host operating system of the host device provides the control command to the virtual operating system, and the virtual operating system displays the control command.

For example, after the host operating system of the PC receives the control command sent by the mobile phone, the host operating system provides the virtual operating system with the control command, and the virtual operating system displays the control command in the virtual running environment of the PC. Preferably, the same type of operating system as the virtual operating system is run on the mobile phone, so that when the control command is displayed on the PC, the control command can be directly displayed without extra redundant processing because the two systems are the same. For example, the virtual operating system is an Android system, the mobile phone is also an Android system, after receiving a control command of a user, the mobile phone sends the control command to a host operating system (for example, a Windows system) of the PC, the host system provides the control command to the virtual operating system, namely, the Android system, and the virtual operating system displays the control command.

Therefore, the method provided by the invention can be used for controlling the virtual environment of the PC on a mobile phone without depending on a keyboard and a mouse of the PC, and the mobile terminal such as the mobile phone can provide a visual and convenient touch screen operation mode, and the mobile phone is not limited on the PC and is very convenient to use. For example, for a game user, after the method of the present invention is adopted, the user can control the game on the control interface provided by the mobile phone, and simultaneously enjoy the large interface game scene provided by the PC, so that the experience is improved.

In step S103 of the method provided above, one premise for executing "the host operating system of the host device provides the control command to the virtual operating system" is that a communication connection is established between the host operating system and the virtual operating system. In the prior art, the VirtualBox is generally completely relied on to realize the communication between the host operating system and the virtual operating system, however, the realization of the virtual android system by the VirtualBox has at least the following problems: first, because the VirtualBox virtual machine is off-hook non-customizable, it is virtually unacceptable for a product that wishes to customize its appearance. Second, if there is no additional input control optimization component, the VirtualBox will lock the user's mouse active range on the current virtual machine window, and the input control for the Guest system such as android is not really smooth. That is, locking the active range of the mouse in the current window by the VirtualBox greatly affects the user experience, and the smoothness of the input control cannot be guaranteed for different Guest systems. The VirtualBox locks the active range of the mouse in the current window due to the product policy of the VirtualBox. In addition, because the VirtualBox is an open-source general virtual machine software, an operating system which can be run on the VirtualBox is not limited to Android, and although the VirtualBox can provide input control for running a Guest system therein, the Guest systems are various in types, and therefore, each of the operating systems cannot achieve a very good effect. The input control of the Android is not smooth enough. Therefore, the invention provides a new way for connecting the host operating system and the virtual operating system.

The method for establishing the connection between the host operating system and the virtual operating system reduces the dependence on the VirtualBox virtual machine as much as possible, effectively improves the user experience, ensures good compatibility and has very good expandability technically.

Therefore, before step S103 of the method shown in fig. 1, a step of establishing a communication connection between the host operating system and the virtual operating system is further included.

The process of establishing a communication connection between the host operating system and the virtual operating system is described with reference to fig. 2.

S201: the virtual operating system is started by a simulation control program in the host operating system.

The host operating system and the virtual operating system need to establish a network connection in advance, and the network connection can be configured by the host system, for example, by configuring (adding) a virtual network connection dedicated for communication and enabling the host system and the virtual system to communicate in the virtual network connection. For a network connection between the host operating system and the virtual operating system, the following are illustrated 1) this virtual network connection may be provided by a VirtualBox; 2) the virtual network configuration is carried out before the virtual system is started, and is routine operation before each start so as to ensure that the host is communicated with the virtual system network; 3) the strategy is that if the virtual connection does not exist, a new virtual connection can be created through a virtual machine such as a VirtualBox; if a virtual connection is created or already exists, the connection parameters (IP address, gateway, etc.) are configured to ensure that the host and virtual system are connected.

After the host operating system establishes a network connection with the virtual operating system, the virtual operating system is started by a simulation control program in the host operating system.

In the present invention, the simulation control program is also called player, and in a specific implementation, the simulation control program can be implemented in an android simulator. As described above, the virtual operating system generally runs in a virtual machine such as a VirtualBox, and therefore, in a specific implementation, the VirtualBox virtual machine may be controlled by a layer program in the host operating system, and the VirtualBox virtual machine starts the virtual operating system.

S202: the virtual operating system loads a predefined script through the base process to provide the IP address of the virtual operating system to the host operating system, and the virtual input service process is started through the base process.

For example, the virtual machine is a VirtualBox virtual machine, and the virtual operating system refers to an Android system. The method comprises the following specific implementation processes that firstly, an android system loads a predefined script (shell script) through a basic process (init process), runs a client extension component of a VirtualBox virtual machine, and writes an IP address of the android system into a client attribute of the VirtualBox virtual machine; then, the host operating system reads the client attribute of the VirtualBox virtual machine and acquires the IP address of the android system.

Those skilled in the art understand that in an android system, after the kernel starts itself (has been loaded into memory, starts running, initializes all device drivers and data structures, etc.), the boot process is completed by starting a user-level program init. Init is always the first process (its process number is always 1). The invention uses the init process to load a shell script with a predefined function, and realizes the control of the client extension component of the VirtualBox virtual machine.

The Shell script (Shell script) is similar to batch processing under Windows/Dos, namely, various commands are put into a file in advance to facilitate one program file executed at one time.

The client extension component (VirtualBox guest additions) of the VirtualBox virtual machine, also called the client enhancement package, mainly functions to increase: shared folders, seamless windows, 3D virtualized display. The client extension component is a collection of software packages, is operated in the VirtualBox virtual machine, and aims to improve the performance of the virtual machine and increase the interactivity and communication with Host. It can be seen that in order to better enable interaction between Host and Guest, VirtualBox provides a Guest extension component. Therefore, in the invention, before the communication connection is established, the IP address of Guest is transmitted to Host through a client attribute (Guest property) mechanism provided by a Guest extension component.

Besides providing an IP address to the Host by loading a shell script, the init process also starts a key virtual input service process in the android system, which is also called a Vinput process in the invention. Vinput is a key process which is arranged in the Android system and used for controlling Guestandroid system input. By means of init control, the vinput process is guaranteed to be started while the android system is started.

S203: and the host operating system establishes the connection between the simulation control program and the virtual input service process according to the IP address of the virtual operating system.

Specifically, a vinput process can establish a communication connection with the Player program at a designated port of the virtual operating system.

Through the scheme shown in fig. 2, the simulator (i.e., Player) running in the Host system acquires the IP address of the Android system, the Host establishes a communication connection with the vinput process in the Android system through the IP address, an actual user sees the image actually running in the Android system on the window displayed by the simulator of the Host system and inputs the image on the simulator window through a keyboard/mouse, the simulator converts the acquired user input data and then sends the converted user input data to the vinput process in the Android system through the communication connection, and the vinput process converts the input data into actual control over the Android system.

As mentioned above, in the prior art, the virtual box locks the active range of the mouse in the current window, which is caused by the product policy of the virtual box, greatly affects the user experience, and cannot guarantee the smoothness of input control for different Guest systems. The mode adopted by the invention does not depend on the display and input control mode of the VirtualBox any more, so the mode is not influenced by the defects of the VirtualBox. In addition, the VirtualBox is an open-source general virtual machine software, an operating system which can be operated on the VirtualBox is not limited to Android, although the VirtualBox can provide input control for operating a Guest system therein, but the Guest systems are various, so that each of the Guest systems cannot achieve a very good effect, the input control of the Guest systems to the Android is not smooth enough, and the input control mode provided by the invention is completely customized for the Android, so that very smooth experience can be achieved.

It is understood by those skilled in the art that although the foregoing technical descriptions are all premised on that Host and Guest are on the same physical machine, since the only relationship between the Player running in Host and the Android running in Guest is actually one communication connection, the technique of the present invention can be applied as long as the communication connection can be established. Therefore, even if the Player and the Android run on different physical machines, virtual input control is possible.

Therefore, in specific implementation, the above method includes, but is not limited to, the case where the virtual operating system and the host operating system run on the same operability or the same physical PC, and the same applies to the case where the virtual operating system runs on other operating systems or other physical PCs; similarly, the above method includes, but is not limited to, the case where the virtual operating system runs in the form of a virtual machine, and the same applies to the case where the virtual operating system runs on an actual physical device.

For the case of a virtual operating system running on a virtual machine, see fig. 3 and 4. Fig. 3 illustrates a situation where a virtual machine runs on a physical device where a Host operating system is located, that is, the virtual machine runs on the device where the Host operating system is located, and the virtual operating system runs on the virtual machine, for example, Guest runs on a VirtualBox, and the VirtualBox runs on Host. FIG. 4 illustrates a situation where a virtual machine is running on another physical device than the physical device on which the host operating system is located, for example, the host operating system is running on a first device (e.g., PC1), the virtual machine is running on a second device (e.g., PC2), and the virtual operating system is running on the virtual machine.

For the case where the virtual operating system runs on another physical device independent from the physical device on which the host operating system is located, without depending on the virtual machine, please refer to fig. 5. FIG. 5 illustrates a scenario where the virtual operating system runs directly on another physical device different from the physical device on which the host operating system is located, for example, the host operating system runs on a first device (e.g., a PC) and the virtual operating system runs on a second device (e.g., a cell phone). Here, it is required that the second device is a device that can directly run an operating system, such as a smartphone.

It can be seen that the solution for connection between the host operating system and the virtual operating system provided by the present invention has the capability of being implemented in a distributed environment.

After the flow shown in fig. 2 is executed, a communication connection between the host operating system and the virtual operating system, that is, a connection between a player program in the host operating system and a vinput process in the virtual operating system, may be established. After receiving the control command sent by the mobile terminal in step S103 in fig. 1, the host operating system may send the control command to the vinput process by the player program, and then the virtual operating system displays the control command.

The following describes a process for establishing a communication connection between a host operating system and a virtual operating system according to another embodiment of the present invention from the perspective of three-party interaction among a palette program, a VirtualBox, and an Android. It can be understood that the layout shown in fig. 3 is adopted in this another embodiment, that is, the VirtualBox runs at the Host end, and the Android (Guest end) runs at the VirtualBox, where the palette program is implemented at the Host end, and the program that implements the main functions of the present invention in cooperation with the vinput in the Android can be implemented in the Android simulator.

Thus, implementations of the invention include the emulation control program Player running on the Host operating system (Host) and the receiving program vinput running on the virtual android system (Guest), as well as the android system itself running on the virtual machine.

(1) Logic of Player program

The Player starts the Android system by calling the VirtualBox; then, trying to acquire an IP address of the Android system through a gusteporty mechanism of the VirtualBox; after the IP address of the Android system is obtained, communication connection is established with vinput running in the Android system; then, the Android system can send the user input received by the Player.

In the aforementioned prior art, the Android system is run through the VirtualBox (the VirtualBox is not controlled through a palette program process in the Android simulator), the Android can be normally run, but the Android system cannot be commercialized due to the limitation of the aforementioned drawbacks. The big premise of the invention is that in the whole scheme of the Android simulator, although the VirtualBox is still needed to run the Android system, the whole work of the VirtualBox is background and invisible, and the whole work is shown to the user as the Android simulator (namely the Player). Therefore, the Android simulator directly controls the VirtualBox running in the background, and some new technologies are adopted to replace the work which needs the VirtualBox originally, including the image rendering work and the input control work which is described in the invention.

(2) Android system logic

Starting an Android system, namely starting a linux kernel, then starting an Android basic process init, wherein the process loads a configuration file init. In the process, the invention particularly enables the init process to load a shell script and complete a key action, namely, the IP address of the current system is written into the Guest property by means of a Guest extension component (VirtualBoxGuest extensions) of the VirtualBox, so that the external Player can acquire the IP address of the current Android. Subsequently, the init process is caused to start a virtual input service process, i.e., a vinput process. The process will wait at a specific port for communication to be established with the Player program. Once the connection with the Player program is established, the vinput process continuously receives the control command which is sent by the Player program and is input by the user on the mobile phone, and the virtual Android system processes and displays the control command.

Referring to FIG. 6, a flow diagram of establishing a communication connection between a host operating system and a virtual operating system is shown, according to another embodiment of the present invention.

S601: the player program controls the virtual machine of the VirtualBox to start android;

s602: android startup, comprising: linux kernel starting- > android base process init starting- > loading init. rc- > running a virtual input service process vinput, and waiting for connection with the outside;

s603: the Player program acquires the ip address of the android system, and comprises the following steps: android runs init, vbox, sh writes an IP address to the guestproperty, and layer reads the IP address from the guestproperty of VirtualBox;

s604: the Player program establishes tcp connection with a vinput process inside the android and completes initialization;

s605: the Player program receives a control command input by a user from the Host terminal;

s606: the Player program is sent to a vinput process of the android system through a previously established communication channel;

s607: and the Android system displays the control command received by the vinput process.

Referring to fig. 7, a schematic structural diagram of a system for controlling virtual input by using a mobile terminal according to an embodiment of the present invention is shown. The mobile terminal is used as an operation handle to control a virtual operating system parasitizing on a host operating system. The system comprises:

the mobile terminal 701 is configured to establish a connection channel with the host device 702, receive a control command of a user, and send the control command to the host device 702 through the connection channel;

and the host device 702 is configured to provide the control command to the virtual operating system 7022 through the host operating system 7021, and the virtual operating system 7022 displays the control command on the virtual operating system 7022.

Preferably, host operating system 7021 establishes a communication connection with virtual operating system 7022.

Preferably, the first and second liquid crystal materials are,

the host operating system 7021 is configured to start the virtual operating system 7022 through the simulation control program, establish a connection between the simulation control program and an input service process in the virtual operating system 7022 according to the acquired IP address of the virtual operating system 7022, and send the control command to the input service process by the simulation control program;

the virtual operating system 7022 is configured to load a predefined script through the base process, so as to provide the IP address of the virtual operating system 7022 to the host operating system 7021, and start the virtual input service process through the base process, and the virtual input service process receives a control command sent from the emulation control program, and displays the control command on the virtual operating system 7022.

Preferably, the first and second liquid crystal materials are,

virtual operating system 7022 runs on another physical device that is separate from the physical device on which host operating system 7021 is located; or,

the virtual operating system 7022 runs on a virtual machine, where the virtual machine runs on a physical device on which the host operating system 7021 is located, or the virtual machine runs on another physical device different from the physical device on which the host operating system 7021 is located.

Preferably, the first and second liquid crystal materials are,

the virtual machine is a VirtualBox virtual machine;

the host operating system 7021 controls the VirtualBox virtual machine through the simulation control program, and the VirtualBox virtual machine starts the virtual operating system 7022.

Preferably, the first and second liquid crystal materials are,

the virtual machine is a VirtualBox virtual machine;

the virtual operating system 7022 loads a predefined script through an init process, runs a client extension component of the VirtualBox virtual machine, and writes the IP address of the virtual operating system 7022 into the client attribute of the VirtualBox virtual machine;

and the host operating system 7021 reads the client attribute of the VirtualBox virtual machine, and acquires the IP address of the virtual operating system 7022.

Preferably, the first and second liquid crystal materials are,

the virtual operating system 7022 starts a vinput process through an init process; and a connection is established by the vinput process at the designated port with the simulation control program.

Preferably, the same type of operating system as virtual operating system 7022 is running on mobile terminal 701; control over a virtual operating system hosted by a host operating system is achieved by launching an application 7011 on mobile terminal 701, application 7011 providing an operating handle interface

Preferably, the host operating system 7011 includes a Windows operating system, a Mac operating system, or a Linux operating system; the virtual operating system 7022 includes an Android operating system.

Corresponding to the above solution, the present invention further provides a device for controlling virtual input by using a mobile terminal, which is used to control a virtual operating system hosted by a host operating system by using the mobile terminal as an operating handle, wherein the host operating system runs on a host device independent from the mobile terminal, and the device is located at a side of the mobile terminal, as shown in fig. 8, and the device includes:

a connection channel establishing unit 801, configured to establish a connection channel between the mobile terminal and the host device;

the control command processing unit 802 is configured to send a control command of a user, received by the mobile terminal, to the host device through the connection channel, so that the host operating system of the host device provides the control command to the virtual operating system and displays the control command.

Corresponding to the above solution, the present invention further provides a device for controlling virtual input by using a mobile terminal, which is used to control a virtual operating system hosted by a host operating system by using the mobile terminal as an operating handle, where the host operating system runs on a host device independent from the mobile terminal, and the device is located on the host device side, with reference to fig. 9, and the device includes:

a connection channel establishing unit 901, configured to establish a connection channel between the host device and the mobile terminal;

a control command receiving unit 902, configured to receive, through the connection channel, a user control command sent by the mobile terminal;

a control command processing unit 903, configured to provide the control command to the virtual operating system by using a host operating system, so that the control command is displayed on the virtual operating system.

Preferably, the apparatus further comprises a host virtual communication unit 904 for establishing a communication connection between the host operating system and the virtual operating system.

The host virtual communication unit 904 specifically includes:

a start virtual control subunit 9041, configured to control a simulation control program in the host operating system to start the virtual operating system;

a virtual IP address obtaining subunit 9042, configured to obtain an IP address of the virtual operating system;

a virtual connection establishing subunit 9043, configured to establish, according to the IP address of the virtual operating system, a connection between the simulation control program and a virtual input service process in the virtual operating system.

Preferably, the first and second liquid crystal materials are,

the virtual operating system runs on another physical device which is independent from the physical device where the host operating system is located; or,

the virtual operating system runs on a virtual machine, wherein the virtual machine runs on a physical device where the host operating system is located, or the virtual machine runs on another physical device different from the physical device where the host operating system is located.

Preferably, the virtual machine is a VirtualBox virtual machine; the start virtual control subunit 9041 is specifically configured to control the VirtualBox virtual machine through a simulation control program in the host operating system, and start the virtual operating system by the VirtualBox virtual machine.

Preferably, the virtual machine is a VirtualBox virtual machine; the virtual IP address obtaining subunit 9042 is specifically configured to read a client attribute of the VirtualBox virtual machine, and obtain an IP address of the virtual operating system.

Preferably, the virtual connection establishing subunit 9043 is specifically configured to, at a specified port of the virtual operating system, establish a connection between the simulation control program and a vinput process of the virtual operating system.

The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be appreciated by those skilled in the art that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of an apparatus for controlling virtual inputs using a mobile terminal according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

It can be seen that the present invention provides the following solutions:

a1, a method for controlling virtual input by using a mobile terminal, which is used for controlling a virtual operating system parasitized on a host operating system by using the mobile terminal as an operation handle, wherein the host operating system runs on a host device independent from the mobile terminal, the method comprising:

establishing a connection channel between the mobile terminal and the host device;

the mobile terminal receives a control command of a user and sends the control command to the host equipment through the connection channel;

and the host operating system of the host device provides the control command to the virtual operating system, and the virtual operating system displays the control command on the virtual operating system.

A2, the method of claim 1, further comprising establishing a communication connection between the host operating system and the virtual operating system.

A3, the method of A2, the establishing a communication connection between the host operating system and the virtual operating system, comprising:

starting the virtual operating system through a simulation control program in the host operating system;

the virtual operating system loads a predefined script through a base process, so that the IP address of the virtual operating system is provided for the host operating system, and a virtual input service process is started through the base process;

and the host operating system establishes the connection between the simulation control program and the virtual input service process according to the IP address of the virtual operating system.

A4, method according to A3,

the virtual operating system runs on another physical device which is independent from the physical device where the host operating system is located; or,

the virtual operating system runs on a virtual machine, wherein the virtual machine runs on a physical device where the host operating system is located, or the virtual machine runs on another physical device different from the physical device where the host operating system is located.

A5, the method as in A4, the virtual machine is a VirtualBox virtual machine;

the starting of the virtual operating system by the simulation control program in the host operating system comprises: and controlling the VirtualBox virtual machine through a simulation control program in the host operating system, and starting the virtual operating system by the VirtualBox virtual machine.

A6, the method as in A4, the virtual machine is a VirtualBox virtual machine;

the virtual operating system loads a predefined script through an underlying process to provide the IP address of the virtual operating system to the host operating system, comprising:

the virtual operating system loads a predefined script through an init process, runs a client extension component of the VirtualBox virtual machine, and writes an IP address of the virtual operating system into a client attribute of the VirtualBox virtual machine;

and the host operating system reads the client attribute of the VirtualBox virtual machine and acquires the IP address of the virtual operating system.

A7, method according to A3,

the starting of the virtual input service process through the base process comprises the following steps: starting a vinput process through an init process;

the establishing of the connection between the simulation control program and the virtual input service process includes: and at a designated port of the virtual operating system, the vinput process establishes connection with the simulation control program.

A8, the method according to claim 1, running the same type of operating system as the virtual operating system on the mobile terminal; and controlling the virtual operating system parasitized on the host operating system by starting an application program on the mobile terminal, wherein the application program provides an operating handle interface.

A9, the method of any one of A1-A8, wherein the host operating system comprises a Windows operating system, a Mac operating system or a Linux operating system; the virtual operating system comprises an Android operating system.

B10, an apparatus for controlling virtual input by using a mobile terminal, for using the mobile terminal as an operation handle to implement control of a virtual operating system hosted by a host operating system, wherein the host operating system runs on a host device independent from the mobile terminal, and the apparatus is located at the side of the mobile terminal, the apparatus comprising:

a connection channel establishing unit, configured to establish a connection channel between the mobile terminal and the host device;

and the control command processing unit is used for sending the control command of the user received by the mobile terminal to the host device through the connection channel, so that the host operating system of the host device provides the control command for the virtual operating system and displays the control command.

C11, an apparatus for controlling virtual input by using a mobile terminal, the apparatus being configured to use the mobile terminal as an operation handle to control a virtual operating system hosted by a host operating system, wherein the host operating system runs on a host device independent from the mobile terminal, and the apparatus is located on a host device side, and the apparatus includes:

a connection channel establishing unit, configured to establish a connection channel between the host device and the mobile terminal;

a control command receiving unit, configured to receive, through the connection channel, a user control command sent by the mobile terminal;

a control command processing unit to provide the control command to the virtual operating system using a host operating system such that the control command is displayed on the virtual operating system.

C12, the apparatus according to C11, further comprising a host virtual communication unit for establishing a communication connection between the host operating system and the virtual operating system.

C13, the apparatus as in C12, wherein the host virtual communication unit specifically includes:

a virtual control starting subunit, configured to control a simulation control program in the host operating system to start the virtual operating system;

a virtual IP address obtaining subunit, configured to obtain an IP address of the virtual operating system;

and the virtual connection establishing subunit is used for establishing the connection between the simulation control program and the virtual input service process in the virtual operating system according to the IP address of the virtual operating system.

C14, device according to C13,

the virtual operating system runs on another physical device which is independent from the physical device where the host operating system is located; or,

the virtual operating system runs on a virtual machine, wherein the virtual machine runs on a physical device where the host operating system is located, or the virtual machine runs on another physical device different from the physical device where the host operating system is located.

C15, the apparatus as described in C14, the virtual machine is a VirtualBox virtual machine; the virtual control starting subunit is specifically configured to control the VirtualBox virtual machine through a simulation control program in the host operating system, and start the virtual operating system by the VirtualBox virtual machine.

C16, the apparatus as described in C14, the virtual machine is a VirtualBox virtual machine; the virtual IP address obtaining subunit is specifically configured to read a client attribute of the VirtualBox virtual machine, and obtain an IP address of the virtual operating system.

C17, the apparatus according to C13, wherein the virtual connection establishing subunit is specifically configured to, at a designated port of the virtual operating system, establish a connection between the simulation control program and a vinput process of the virtual operating system.

D18, a system for controlling virtual input by using a mobile terminal, which is used to control a virtual operating system parasitized on a host operating system by using the mobile terminal as an operating handle, the system comprising:

the mobile terminal is used for establishing a connection channel with the host equipment, receiving a control command of a user, and sending the control command to the host equipment through the connection channel;

and the host equipment is used for providing the control command to the virtual operating system through a host operating system, and the virtual operating system displays the control command on the virtual operating system.

D19, the system for controlling virtual input by using a mobile terminal as described in D18, the host operating system establishing a communication connection with the virtual operating system.

D20 System for controlling virtual input by means of a Mobile terminal as described in D19,

the host operating system is used for starting the virtual operating system through a simulation control program, establishing connection between the simulation control program and an input service process in the virtual operating system according to the acquired IP address of the virtual operating system, and sending the control command to the input service process by the simulation control program;

the virtual operating system is used for loading a predefined script through a basic process so as to provide the IP address of the virtual operating system for the host operating system, starting a virtual input service process through the basic process, receiving a control command sent by the simulation control program through the virtual input service process, and displaying the control command on the virtual operating system.

D21 System for controlling virtual input by means of a Mobile terminal as described in D20,

the virtual operating system runs on another physical device which is independent from the physical device where the host operating system is located; or,

the virtual operating system runs on a virtual machine, wherein the virtual machine runs on a physical device where the host operating system is located, or the virtual machine runs on another physical device different from the physical device where the host operating system is located.

D22, the system for controlling virtual input by using a mobile terminal as described in D21, wherein the virtual machine is a VirtualBox virtual machine;

and the host operating system controls the VirtualBox virtual machine through a simulation control program, and the VirtualBox virtual machine starts the virtual operating system.

D23, the system for controlling virtual input by using a mobile terminal as described in D21, wherein the virtual machine is a VirtualBox virtual machine;

the virtual operating system loads a predefined script through an init process, runs a client extension component of the VirtualBox virtual machine, and writes the IP address of the virtual operating system into the client attribute of the VirtualBox virtual machine;

and the host operating system reads the client attribute of the VirtualBox virtual machine and acquires the IP address of the virtual operating system.

D24 System for controlling virtual input by means of a Mobile terminal as described in D20,

the virtual operating system starts a vinput process through an init process; and establishing a connection with the simulation control program at a designated port by the vinput process.

D25, the system for controlling virtual input using a mobile terminal as described in D18, running the same type of operating system as the virtual operating system on the mobile terminal; controlling a virtual operating system hosted by a host operating system by starting an application on the mobile terminal, the application providing an operating handle interface

D26, a system for controlling virtual input by using a mobile terminal as described in any one of D18-D26, the host operating system comprising a Windows operating system, a Mac operating system or a Linux operating system; the virtual operating system comprises an Android operating system.

Claims (10)

1. A method for controlling virtual input by using a mobile terminal, the method being used for controlling a virtual operating system hosted by a host operating system by using the mobile terminal as an operating handle, wherein the host operating system runs on a host device independent from the mobile terminal, the method comprising:

establishing a connection channel between the mobile terminal and the host device;

the mobile terminal receives a control command of a user and sends the control command to the host equipment through the connection channel;

and the host operating system of the host device provides the control command to the virtual operating system, and the virtual operating system displays the control command on the virtual operating system.

2. The method of claim 1, further comprising establishing a communication connection between the host operating system and the virtual operating system.

3. The method of claim 2, wherein said establishing a communication connection between said host operating system and said virtual operating system comprises:

starting the virtual operating system through a simulation control program in the host operating system;

the virtual operating system loads a predefined script through a base process, so that the IP address of the virtual operating system is provided for the host operating system, and a virtual input service process is started through the base process;

and the host operating system establishes the connection between the simulation control program and the virtual input service process according to the IP address of the virtual operating system.

4. The method of claim 3,

the virtual operating system runs on another physical device which is independent from the physical device where the host operating system is located; or,

the virtual operating system runs on a virtual machine, wherein the virtual machine runs on a physical device where the host operating system is located, or the virtual machine runs on another physical device different from the physical device where the host operating system is located.

5. The method of claim 4, wherein the virtual machine is a VirtualBox virtual machine;

the starting of the virtual operating system by the simulation control program in the host operating system comprises: and controlling the VirtualBox virtual machine through a simulation control program in the host operating system, and starting the virtual operating system by the VirtualBox virtual machine.

6. The method of claim 4, wherein the virtual machine is a VirtualBox virtual machine;

the virtual operating system loads a predefined script through an underlying process to provide the IP address of the virtual operating system to the host operating system, comprising:

the virtual operating system loads a predefined script through an init process, runs a client extension component of the VirtualBox virtual machine, and writes an IP address of the virtual operating system into a client attribute of the VirtualBox virtual machine;

and the host operating system reads the client attribute of the VirtualBox virtual machine and acquires the IP address of the virtual operating system.

7. The method of claim 3,

the starting of the virtual input service process through the base process comprises the following steps: starting a vinput process through an init process;

the establishing of the connection between the simulation control program and the virtual input service process includes: and at a designated port of the virtual operating system, the vinput process establishes connection with the simulation control program.

8. An apparatus for controlling virtual input by using a mobile terminal, the apparatus being configured to use the mobile terminal as an operation handle to implement control of a virtual operating system hosted by a host operating system, wherein the host operating system runs on a host device separate from the mobile terminal, and the apparatus is located on a side of the mobile terminal, the apparatus comprising:

a connection channel establishing unit, configured to establish a connection channel between the mobile terminal and the host device;

and the control command processing unit is used for sending the control command of the user received by the mobile terminal to the host device through the connection channel, so that the host operating system of the host device provides the control command for the virtual operating system and displays the control command.

9. An apparatus for controlling virtual input by using a mobile terminal, the apparatus being configured to use the mobile terminal as an operation handle to control a virtual operating system hosted by a host operating system, wherein the host operating system runs on a host device independent from the mobile terminal, and the apparatus is located on a host device side, the apparatus comprising:

a connection channel establishing unit, configured to establish a connection channel between the host device and the mobile terminal;

a control command receiving unit, configured to receive, through the connection channel, a user control command sent by the mobile terminal;

a control command processing unit to provide the control command to the virtual operating system using a host operating system such that the control command is displayed on the virtual operating system.

10. A system for controlling virtual input by using a mobile terminal, the system being configured to control a virtual operating system hosted by a host operating system by using the mobile terminal as an operating handle, the system comprising:

the mobile terminal is used for establishing a connection channel with the host equipment, receiving a control command of a user, and sending the control command to the host equipment through the connection channel;

and the host equipment is used for providing the control command to the virtual operating system through a host operating system, and the virtual operating system displays the control command on the virtual operating system.