CN114721617A

CN114721617A - Cross-screen control system, method, terminal device and storage medium

Info

Publication number: CN114721617A
Application number: CN202210220862.XA
Authority: CN
Inventors: 潘重光; 李成贵
Original assignee: Beijing Zhiyou Yidong Technology Co ltd
Current assignee: Beijing Zhiyou Yidong Technology Co ltd
Priority date: 2022-03-08
Filing date: 2022-03-08
Publication date: 2022-07-08

Abstract

The embodiment of the application provides a cross-screen control system, a cross-screen control method, terminal equipment and a storage medium. In the embodiment of the application, a first terminal device and a second terminal device can establish communication connection, a cross-screen control interface including a touch operation area is displayed on the first terminal device, so that a user can interact with the first terminal device through the touch operation area to generate a cross-screen operation instruction, the operation instruction can be transmitted to the side of the second terminal device based on the communication connection, and the second terminal device executes a corresponding function based on the cross-screen operation instruction, so that the user can realize cross-screen control on the second terminal device through touch operation of the first terminal device, and is not limited to an external device or a mouse and a keyboard which are provided by the user, so that the problem that the use control is not flexible when the second terminal device is controlled is solved.

Description

Cross-screen control system, method, terminal device and storage medium

Technical Field

The present application relates to the field of communications technologies, and in particular, to a cross-screen control system, a cross-screen control method, a terminal device, and a storage medium.

Background

At present, common intelligent devices such as computers and televisions are generally controlled by dedicated external devices or control devices provided on the body of the intelligent devices, but users are limited in use in various aspects such as scenes, hardware and installation steps during operation. For example, a computer can only be controlled by a mouse and a keyboard which are externally accessed or are arranged on the body of the computer, and the use of the computer is limited within a certain range; the television is controlled by the remote controller, and the operation is not flexible.

Disclosure of Invention

Aspects of the present application provide a cross-screen control system, method, terminal device and storage medium, so as to solve the problem that some smart devices are not flexible enough to control in use.

The embodiment of the application provides a cross-screen control system, including: the system comprises a first terminal device and a second terminal device, wherein the first terminal device is in communication connection with the second terminal device, an information input area is displayed on a display screen of the second terminal device, a cross-screen control interface is displayed on the display screen of the first terminal device, and the cross-screen control interface comprises a touch operation area corresponding to the information input area; the first terminal device is used for responding to cursor positioning operation in the touch operation area and sending screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device; responding to an input trigger operation in the touch operation area, displaying the virtual keyboard, responding to an input operation on the virtual keyboard, and sequentially sending at least one input atom instruction message to the second terminal equipment; and the second terminal device is used for positioning a cursor position in the information input region according to the screen position information or the screen position change information sent by the first terminal device, displaying at least one atom instruction information sent by the first terminal device in the information input region according to the cursor position until a complete screen-crossing operation instruction is obtained, and executing a corresponding function according to the screen-crossing operation instruction, wherein the screen-crossing instruction operation comprises at least one atom instruction information.

The embodiment of the application further provides a cross-screen control method, which is applicable to the first terminal device, and the method comprises the following steps: when the cross-screen control of the second terminal equipment is needed, a cross-screen control interface is displayed on a display screen, the cross-screen control interface comprises a touch operation area, and the touch operation area corresponds to an information input area displayed on the display screen of the second terminal equipment; responding to cursor positioning operation in the touch operation area, and sending screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal equipment so that the second terminal equipment can position a cursor position in the information input area; responding to an input trigger operation in the touch operation area, displaying the virtual keyboard, responding to an input operation on the virtual keyboard, sequentially sending at least one input atom instruction message to the second terminal device, so that the second terminal device displays the at least one atom instruction message in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction, wherein the cross-screen instruction operation comprises the at least one atom instruction message.

The embodiment of the application further provides another cross-screen control method, which is suitable for a second terminal device, and the method comprises the following steps: when the first terminal equipment is required to carry out cross-screen control, displaying an information input area on a display screen, so that the first terminal equipment can display a touch operation area corresponding to the information input area; receiving screen position information or screen position change information, wherein the screen position information or the screen position change information is sent by the first terminal equipment in response to cursor positioning operation in the touch operation area; positioning a cursor position in the information input area according to the screen position information or the screen position change information; sequentially receiving at least one atom instruction message, wherein the at least one atom instruction message is sequentially sent by the first terminal device in response to the input operation on the virtual keyboard; and displaying at least one atom instruction information in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction, wherein the cross-screen operation instruction comprises at least one atom instruction information.

An embodiment of the present application further provides a terminal device, which can be implemented as a first terminal device, where the terminal device includes: a memory and a processor; the memory is used for storing computer programs, and the processor is coupled with the memory and used for executing the computer programs so as to realize the steps in the cross-screen control method suitable for the first terminal equipment.

An embodiment of the present application further provides a terminal device, which can be implemented as a second terminal device, where the terminal device includes: a memory and a processor; the memory is used for storing a computer program, and the processor is coupled with the memory and used for executing the computer program to realize the steps in the cross-screen control method suitable for the second terminal equipment.

Embodiments of the present application also provide a computer readable storage medium storing a computer program, which, when executed by a processor, causes the processor to implement the steps of the above-mentioned method.

According to the technical scheme provided by each embodiment of the application, the first terminal device and the second terminal device can establish communication connection, a cross-screen control interface comprising a touch operation area is displayed on the first terminal device, so that a user can interact with the first terminal device through the touch operation area to generate a cross-screen operation instruction, the operation instruction can be transmitted to the second terminal device side based on the communication connection, the second terminal device executes corresponding functions based on the cross-screen operation instruction, the user can realize cross-screen control on the second terminal device through touch operation of the first terminal device, the cross-screen control is not limited by external equipment, and the limitation of a mouse, a keyboard and the like on the second terminal device to a use range is not limited, and the problem that the use control is not flexible when the second terminal device is controlled is solved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:

FIG. 1 is a schematic structural diagram of a cross-screen control system according to an exemplary embodiment of the present application;

FIG. 2 is a flowchart illustrating a cross-screen control method according to an exemplary embodiment of the present disclosure;

FIG. 3 is a schematic flowchart of a cross-screen control method according to another exemplary embodiment of the present application;

fig. 4 is a schematic structural diagram of a terminal device according to an exemplary embodiment of the present application;

fig. 5 is a schematic structural diagram of a terminal device according to another exemplary embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the prior art, when common intelligent devices, such as a desktop computer, a notebook computer, a tablet computer, a television, and the like, are controlled by a dedicated external device or a control device provided in a body of the intelligent device, a user may be limited in use in various aspects, such as a variety of scenes, hardware, and installation steps, during an operation process, and related problems mainly include the following aspects:

1. the desktop computer needs to use an external keyboard to input contents, needs to use an external mouse to move a cursor and select a target, and both the external devices lack the same and the desktop computer cannot be normally used, and the external devices need to be used within an effective range of the keyboard and the mouse to control the computer.

2. The notebook computer can use the body self-contained input equipment, including the body self-contained keyboard and the touch pad of the mouse, but the body self-contained input equipment must be limited to be used within a certain range with the screen, and the external equipment, including the keyboard and the mouse, is required to be used like a desktop computer when the use range is exceeded.

3. The tablet computer can directly click and select on the screen, and can use a virtual keyboard on the screen of the tablet computer to input contents, thereby completely replacing an external keyboard and a mouse. However, since only the selection and input operations can be performed on the screen of the tablet computer, the operation cannot be performed when the tablet computer is out of the control range of the finger due to the palm.

4. The television adopts an external remote controller to perform selection operation, but only can perform up-down, left-right option movement and selection, the flexibility of mouse operation is avoided, meanwhile, the input content is selectively input by using the mouse up-down, left-right without connecting an external keyboard, the operation is extremely complicated, and the limitation is the same as that of a desktop after the external keyboard and the mouse are connected.

To solve the above problems in the prior art, embodiments of the present application provide a solution, and the basic idea is: the first terminal device and the second terminal device can establish communication connection, a cross-screen control interface comprising a touch operation area is displayed on the first terminal device, a user can interact with the first terminal device through the touch operation area to generate a cross-screen operation instruction, the operation instruction can be transmitted to the side of the second terminal device based on communication connection, and the second terminal device executes corresponding functions based on the cross-screen operation instruction, so that the user can realize cross-screen control on the second terminal device through touch operation of the first terminal device, the cross-screen control is not limited by external equipment, and is not limited by a mouse, a keyboard and the like, so that the problem that the use range is limited when the second device is controlled is solved, and the flexibility of controlling or using the second terminal device is improved.

The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.

Fig. 1 is a schematic structural diagram of a cross-screen control system according to an exemplary embodiment of the present application. As shown in fig. 1, the system includes: a first terminal device 101 and a second terminal device 102.

In this embodiment, the first terminal device 101 is an intelligent device having a display screen and a wireless communication function, a cross-screen control interface is displayed on the display screen of the first terminal device 101, the cross-screen control interface includes a touch operation area, and a user may interact with the first terminal device 101 through the touch operation area to generate a cross-screen operation instruction, which may be transmitted to the second terminal device 102 side based on the communication connection. The first terminal device 101 may be various smart handheld devices (e.g., a smart phone, a tablet computer, etc.), or various smart wearable devices (e.g., a smart band, a smart watch, etc.). The touch operation area of the first terminal device 101 is distributed on the cross-screen control interface, for example, the touch operation area may be distributed on the entire cross-screen control interface, or may be a partial area on the cross-screen control interface.

In the embodiment of the present application, the second terminal device 102 may be another intelligent device having a display screen and a wireless communication function. The second terminal device 102 may provide some audio and video services, online shopping services, various smart home services, and the like for the user, and may be, for example, a computer device (e.g., a desktop computer, a notebook computer, a tablet computer, and the like), or various smart appliances with a display screen (e.g., a smart television, a smart large screen, or a smart robot, and the like).

In this embodiment, the user directly controls or uses the second terminal device 102, or may control or use the second terminal device 102 through various external devices supported by the second terminal device 102, such as a remote controller, a mouse, a keyboard, a touch pen, or the like. In addition, in this embodiment, the first terminal device 101 may further establish a communication connection with the second terminal device 102, and the user may send a cross-screen operation instruction to the second terminal device 102 through the first terminal device 101, so as to implement a cross-screen remote control operation on the second terminal device 102. In this case, the problem that the second terminal device 102 is inconvenient to operate when being controlled or used can be solved by the convenience of the user operating the first terminal device 101, and the control or use flexibility of the second terminal device 102 is improved without being limited by external devices or being limited by the use range of a mouse, a keyboard and the like. In an optional embodiment, the first terminal device 101 may be a smart phone supporting touch operation, and the second terminal device 102 may be a smart television, a notebook computer, or the like.

It is explained that, in the embodiment of the present application, in order to support the cross-screen remote operation of the second terminal device 102 by the first terminal device 101, an application program supporting the cross-screen control operation may be installed and run on the first terminal device 101; operating system software supporting cross-screen control is installed and run on the second terminal device 102. Specifically, the application program on the first terminal device 101 and the operating system software of the second terminal device 102 cooperate with each other, so that the user can be assisted to complete the cross-screen remote operation on the second terminal device 102 through the touch operation on the first terminal device 101; accordingly, the second terminal device 102 may execute a corresponding function based on the cross-screen operation instruction sent by the first terminal device 101.

In this embodiment, the second terminal device 102 is pre-installed and runs operating system software required for performing cross-screen control in cooperation with the first terminal device 101, and the operating system software supports all functions of the second terminal device 102, for example, when the second terminal device 102 is a television, the operating system software installed on the television supports various functions of searching for a television program of the television, playing audio, changing channels, and the like. That is, all functions of the second terminal apparatus 102 need to be integrated into the operating system software installed in the second terminal apparatus 102, and all functions are functions at the operating system level, so as to achieve the purpose that all functions can be applied. Correspondingly, to implement the cross-screen control on the second terminal device 102, the first terminal device 101 needs to install and run an application program required for the cross-screen control on the second terminal device 102 in advance on the first terminal device 101, that is, the application program required for the cross-screen control on the first terminal device 101 is adapted to the operating system software of the second terminal device 102, which supports the cross-screen control. The application program of the first terminal device 101 may be an independent APP or an applet that runs on the independent APP.

In this embodiment, in a case where the first terminal device 101 needs to perform cross-screen control on the second terminal device 102, the first terminal device 101 needs to establish a communication connection with the second terminal device 102. Optionally, there are various ways for the first terminal device 101 to establish the communication connection with the second terminal device 102, for example, the following ways are used to establish the communication connection:

the first method is as follows: the first terminal apparatus 101 and the second terminal apparatus 102 are connected by a wired manner. The connection mode is that signals are transmitted through wired tools such as cables, optical fibers and HDMI signal lines, information exchange between point-to-point connection of the first terminal device 101 and the second terminal device 102 is completed, wired communication connection is established, and after the communication connection is established successfully, both sides can receive and transmit data.

The second method comprises the following steps: the first terminal device 101 and the second terminal device 102 are connected by bluetooth. The connection mode is that the first terminal device 101 searches for the pairing to be initiated to the second terminal device 102, the wireless communication connection is established, and after the communication connection is established successfully, the two parties can receive and transmit data.

The third method comprises the following steps: the first terminal device 101 and the second terminal device 102 establish communication connection through wifi.

The communication connection method is merely an example, and is not limited thereto.

Preferably, the embodiment of the present application may establish a communication connection between the first terminal device 101 and the second terminal device 102 in a wireless connection manner. Further, a communication connection may be established with operating system software installed on the second terminal apparatus 102 by means of an application installed on the first terminal apparatus 101.

In this embodiment, after the second terminal device 102 is powered on and runs the operating system supporting the cross-screen control, an information code that can be used for scanning is displayed on a display interface of the second terminal device 102, where the information code carries related information of the second terminal device 102, for example, the related information may be information such as a device model and a specific identifier of the second terminal device 102. An information input area is also displayed on the display interface of the second terminal device 102, and the information input area is used for displaying the atom instruction information sent by the first terminal device 101 or the external device in real time. The information input area may be displayed simultaneously with the information code when the second terminal device 102 is powered on, so that the user may select to use different control modes to control the second terminal device 102, for example, the first terminal device 101 may be used to scan the information code and establish a communication connection with the second terminal device, perform remote cross-screen control on the second terminal device 102, and may directly use an external device (such as a remote controller) to perform direct control. Alternatively, the information input area may be displayed on the display interface of the second terminal device 102 after the first terminal device 101 scans the information code to establish a communication connection with the second terminal device 102. The display mode of the information input area and the control mode of the second terminal device 102 are exemplary descriptions, and are not limited to the above.

After opening the application program adapted to the operating system software of the second terminal device 102 in the first terminal device 101, the user performs a scan trigger operation on the cross-screen control interface, where the trigger operation may be to touch the cross-screen control interface through a setting action, for example, the setting action may be a single click, a double click, or a sliding action, and the scan trigger operation is described here as an example and is not limited. Then, the first terminal device 101 acquires the camera right in response to the scanning trigger operation, scans the information code displayed on the display screen of the second terminal device 102, and establishes a communication connection for this cross-screen control with the second terminal device 102 according to the information of the second terminal device 102 carried in the information code. Correspondingly, the first terminal device 101 displays the cross-screen control interface, and also displays a touch operation area corresponding to the information input area on the interface, where the touch operation area corresponds to the information input area, so that a user can conveniently synchronize the atomic instruction information to the information input area of the second terminal device 102 when inputting the atomic instruction information in the touch operation area.

Specifically, after the first terminal device 101 establishes a communication connection for the current cross-screen control with the second terminal device 102, the user may perform cross-screen control on the second terminal device 102 through the touch operation area provided by the first terminal device 101. Further, the first terminal device 101 sends, in response to a cursor positioning operation performed by the user in the touch operation area, screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device 102. The cursor positioning operation may be a single click, a double click, a slide, or the like, and the cursor positioning operation is herein described by way of example and is not limited thereto. Accordingly, the second terminal apparatus 102 positions the cursor position within the information input area according to the screen position information or the screen position change information transmitted from the first terminal apparatus 101.

In this embodiment, the current cursor positioning operation may be a non-initial operation in the current screen-crossing operation process, or may be an initial operation in the current screen-crossing operation process. Correspondingly, responding to the cursor positioning operation in the touch operation area, sending the screen position information or the screen position change information corresponding to the cursor positioning operation to the second terminal device 102, so that the second terminal device 102 can position the cursor position in the information input area, which includes the following two implementation manners:

when the current cursor positioning operation is a non-first cursor positioning operation in the current screen-crossing control process, responding to the current cursor positioning operation in the touch operation area, acquiring screen position change information generated by the current cursor positioning operation relative to the last cursor positioning operation, and sending the screen position change information to the second terminal device 102 so that the second terminal device 102 can reposition the cursor position according to the screen position change information and the current cursor position in the information input area, wherein the screen position change information generated by the current cursor positioning operation relative to the last cursor positioning operation is acquired, a difference value can be obtained based on the screen position information corresponding to the two operations, and the difference value is the screen position change information.

When the current cursor positioning operation is the first cursor positioning operation in the current screen-crossing control process, responding to the current cursor positioning operation in the touch operation area, acquiring screen position information corresponding to the current cursor positioning operation, and sending the screen position information to the second terminal device 102, so that the second terminal device 102 can display a cursor at an initial cursor position preset in the information input area according to the screen position information. The screen position information may be relative position information of a touch position of the touch operation and the screen.

Further, after determining the cursor position, the user may perform an input operation within the touch operation area provided by the first terminal device 101 to input instruction information required for performing a cross-screen operation on the second terminal device 102. For the first terminal device 101, an input trigger operation of a user in a touch operation area of the first terminal device 101 may be responded, a virtual keyboard is displayed, then the user performs an input operation on the virtual keyboard according to a use requirement of the user, the first terminal device 101 responds to the input operation of the user on the virtual keyboard, at least one input atomic instruction information is sequentially sent to the second terminal device 102, so that the second terminal device 102 displays the at least one atomic instruction information in the information input area according to a cursor position until a complete cross-screen operation instruction is obtained, and a corresponding function is executed according to the cross-screen operation instruction. Here, the virtual keyboard is displayed on the display screen of the first terminal apparatus 101 in a set shape and a set size, and the set shape may be a regular pattern or an irregular pattern, for example, the regular pattern may be a square, a rectangle, a polygon, or the like. In this embodiment, the virtual keyboard at least includes the following contents: alphabetic keys, numeric keys, symbol keys, voice input keys, send keys, and handwriting functional areas. The atomic instruction information refers to the smallest unit which is input into the touch operation area by the user through the virtual keyboard each time, and may be, for example, a word, a number, a letter, a symbol, and the like, which are part or all of the entire cross-screen operation instruction. That is, a complete cross-screen operation instruction includes one or more atomic instruction information. Here, the shape, display content, and atomic instruction information of the virtual keyboard are exemplary illustrations, and are not limited to these.

In this embodiment, the first terminal device 101 responds to an input operation of a user on a virtual keyboard, and sequentially sends at least one input atomic instruction message to the second terminal device 102, so that the second terminal device 102 displays at least one atomic instruction message in the information input region according to a cursor position until a complete cross-screen operation instruction is obtained, and executes a corresponding function according to the cross-screen operation instruction, which may be implemented in the following manner: responding to the input operation of a user on the virtual keyboard, and sequentially recording at least one input atom instruction message into an implicit text box associated with the virtual keyboard; and synchronizing the incremental atomic instruction information and the corresponding incremental type thereof to the second terminal device 102 every time the atomic instruction information in the text box changes, so that the second terminal device 102 displays the incremental atomic instruction information at the current cursor position in the information input area until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction. The implicit text box is used for inputting the atomic instruction information and is hidden and displayed in the touch operation area of the first terminal device 101, the implicit text box can weaken the feeling that a user inputs the atomic instruction information through a keyboard and directly displays the atomic instruction information on the screen text box in a traditional mode, the use feeling of remote cross-screen control of inputting the atomic instruction information at the first terminal device 101 by the user and synchronously displaying the atomic instruction information in the information input area of the second terminal device 102 in a mode of communication connection through remote control is enhanced. In this embodiment, the increment types include at least two types of addition and deletion. Wherein, each time an atomic instruction information is input, the atomic instruction information is increased, and each time an atomic instruction information is decreased, the atomic instruction information is deleted, for example, when the atomic instruction information is input incorrectly, the atomic instruction information with input error may need to be deleted. When the atomic instruction information of the first terminal device 101 is added or deleted, the addition or deletion of the atomic information is synchronized to the second terminal device 102, and the addition or deletion of the atomic information is synchronously displayed in the information input box of the second terminal device 102. For example, if the user wants to search for a "tv play" column, the user sequentially inputs nine letters "d", "i", "a", "n", "s", "h", "i", "j", "u" and "u" on the virtual disc of the first terminal device 101, then sequentially and synchronously displays "dianshiju" in the information input box of the second terminal, displays a plurality of corresponding chinese characters on the virtual keyboard along with the letters sequentially input on the virtual disc of the first terminal device 101 by the user, and further displays "tv play" in the information input box of the second terminal in response to the user's selection operation of inputting the chinese character "tv play" corresponding to the letters.

In this embodiment, at least one piece of atomic instruction information may also be voice instruction information, and then synchronizing the incremental atomic instruction information and the corresponding incremental type thereof to the second terminal device 102 may be implemented in the following manner: the incremental voice instruction information is converted into incremental text instruction information, and the incremental text instruction information and the corresponding incremental type thereof are synchronized to the second terminal device 102. Specifically, a voice key may be selected on the virtual keyboard of the first terminal, voice information may be input while the voice key is selected, after the voice information is input, the voice information may be converted into text information through a click operation, and the text information may be synchronized to the second terminal device 102. The conversion of the voice instruction information is exemplified here, and is not limited to the conversion of the voice instruction information.

Further, after the second terminal device 102 receives and displays the complete instruction information in the information input box, the first terminal responds to the execution touch operation of the user on the cross-screen control interface, generates a cross-screen execution instruction, and sends the cross-screen execution instruction to the second terminal device 102. After the second terminal device 102 receives the cross-screen execution instruction, the second terminal device 102 executes a corresponding function according to the atomic instruction information in the information input box. For example, if the complete information displayed in the information input box is "drama", after receiving the cross-screen control instruction, the second terminal device 102 searches for a drama title according to the "drama" information, and provides a drama list, so that the user can further select a drama to be watched through touch operation on the first terminal device 101.

In the process of inputting the atomic instruction information, the second terminal device 102 needs to identify whether the transmission operation of the atomic instruction information is finished, that is, whether a complete cross-screen control instruction appears. In a first optional embodiment, the second terminal device 102 may determine that the current transmission operation is a final transmission operation corresponding to a certain complete screen-crossing control instruction by determining a time interval between each transmission operation and the next transmission operation, and may splice atomic instruction information transmitted by the current transmission operation and adjacent transmission operations whose previous transmission time interval does not exceed the set time interval threshold in sequence to form the complete screen-crossing control instruction, if the time interval is greater than the set time interval threshold, for example, if the next transmission operation does not occur for more than 2 or 3 seconds. Or, in a second optional embodiment, the second terminal device 102 may maintain a supported cross-screen control instruction library in advance, where each cross-screen control instruction is stored in the instruction library, so that when receiving the atomic instruction information transmitted by the first terminal device 101 each time, the atomic instruction information transmitted this time is spliced with the atomic instruction information that has been transmitted in the process of this cross-screen control operation, so as to obtain a control instruction to be identified; matching the control instruction to be identified in a cross-screen instruction library, and if a complete cross-screen control instruction is matched, determining the matched cross-screen control instruction as the cross-screen control instruction formed by splicing the atomic instruction information; if the complete cross-screen control instruction is not matched, continuing to receive other atomic instruction information transmitted by the first terminal device 101 until the complete cross-screen control instruction can be matched in the cross-screen control instruction library.

Further alternatively, in practical applications, there may be a phenomenon of partial or complete overlap between different cross-screen control commands, such as zapping command TV1(TV1 indicates switching to TV channel 1) and TV15(TV15 indicates switching to TV channel 15), for which case a false decision may occur in the second alternative embodiment described above. For example, for the case that the user inputs the TV15, the first terminal device 101 sequentially transmits the atomic instruction information T, V, 1, and 5 to the second terminal device 102, and sequentially displays the atomic instruction information in the information input box of the second terminal device 102, however, when the second terminal device 102 receives the three atomic instruction information T, V and 1, the complete cross-screen control instruction TV1 is matched in the cross-screen control instruction library, so as to directly execute the cross-screen control instruction TV1, that is, switch the current TV channel to the TV channel 1, which obviously goes against the user's expectation.

For the above situation, in an optional embodiment of the present application, the user is allowed to reset the cross-screen control instruction supported by the second terminal device 102, so that different cross-screen control instructions do not overlap with each other or do not overlap with each other, and the second terminal device 102 may respond to an operation initiated by the user through the remote controller or the first terminal device 101 to reset the cross-screen control instruction, and readjust or modify the cross-screen control instruction that overlaps with each other or overlaps with each other according to the input of the user, so that the different cross-screen control instructions have different instruction forms. For example, the zapping command TV1 can be changed to TV01, and the zapping command TV15 remains unchanged, thereby solving the problem of misjudgment.

For the above situation, in another optional embodiment of the present application, the cross-screen control instruction supported by the second terminal device 102 may not be changed, but the second optional embodiment is further improved, specifically, the second terminal device 102 may wait for a set time duration, for example, 1 second or 2 seconds, every time when receiving the atomic instruction information transmitted by the first terminal device 101, and if no new atomic instruction information is transmitted before the preset time duration ends, it indicates that the input operation of the user for the cross-screen remote control is ended, otherwise, if new atomic instruction information is transmitted before the preset time duration technical operation, it indicates that the input operation of the user for the cross-screen remote control is not ended; under the condition that the input operation of the user in the cross-screen remote control is identified to be finished, the transmitted atomic instruction information is spliced with the atomic instruction information which is transmitted in the cross-screen control operation process to obtain a control instruction to be identified; matching the control instruction to be identified in a cross-screen instruction library; if the complete cross-screen control instruction is matched, the matched cross-screen control instruction is the cross-screen control instruction formed by splicing the atomic instruction information; if the complete cross-screen control instruction is not matched, continuing to receive other atom instruction information transmitted by the first terminal device 101, and continuing to execute the operation until the complete cross-screen control instruction can be matched in the cross-screen control instruction library. It should be noted that, it may be determined whether the input operation of the cross-screen remote control by the user is ended or not, and in the case of determining that the input operation is ended, the matching operation of the cross-screen control instruction is executed, but the execution order is not limited. For example, the two operations may be executed in parallel, and the matching operation of the cross-screen control instruction is executed while determining whether the input operation of the cross-screen remote control by the user is ended, and only when it is determined that the input operation of the cross-screen remote control by the user is ended and a complete cross-screen control instruction is matched, the second terminal device 102 may use the matched cross-screen control instruction as the cross-screen control instruction input by the user and execute the matched cross-screen control instruction.

The following describes in detail a process in which the first terminal device 101 controls the second terminal device 102 to execute a corresponding function, taking the first terminal device 101 as a smart phone and the second terminal device 102 as a smart phone as an example.

Firstly, a smart television provided with operating system software supporting cross-screen control and a smart phone provided with an application program adaptive to the operating system software of the smart television are started. After the smart television is started to operate, an information code and an information input frame carrying the smart television can be displayed on a display screen of the smart television, a cross-screen operation interface can be displayed on the display screen of the smart phone, and the cross-screen operation interface comprises a touch operation area. And through the scanning function of the application program of the smart phone, the information code is scanned by using the camera of the smart phone, and the communication connection between the smart phone and the smart television is established.

After the smart phone establishes communication connection with the smart television, the user performs cursor positioning operation in the touch operation area of the smart phone, and the smart phone responds to the cursor positioning operation in the touch operation area by the user and sends screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device 102. The second terminal device 102 positions the cursor to a corresponding position according to the received screen position information or screen position change information.

Further, according to the use requirement of the user, the user triggers an operation to display the virtual keyboard through input in the touch operation area of the mobile phone, responds to the input operation on the virtual keyboard, and sequentially records the input at least one atom instruction information into an implicit text box associated with the virtual keyboard, namely, sequentially sends the input at least one atom instruction information adding or at least one atom instruction information deleting to the second terminal device 102, and the information input area of the second terminal device 102 synchronously displays the added or deleted at least one atom, namely, the second terminal device 102 displays the incremental atom instruction information at the current cursor position in the information input area until a complete cross-screen operation instruction is obtained.

The first embodiment is as follows: the user has a "channel selection" requirement.

The user can input command information of 'xuantai' on a virtual keyboard of the mobile phone, the 'xuantai' is displayed in an implicit text box corresponding to the virtual keyboard and is synchronously displayed in an information input area of the smart television, and in response to the selection of the character 'channel selection' corresponding to the 'xuantai', a 'channel selection' two-character is synchronously displayed in the implicit text box of the mobile phone and the information input area of the smart television. Or the user can select a voice input function on a virtual keyboard of the mobile phone, input channel selection voice information, convert voice into text information through the function of converting voice into characters, and synchronously display channel selection two characters in an implicit text box of the mobile phone and an information input area of the smart television. After a user sees the complete instruction information displayed in the information input area, the cross-screen operation is carried out in the touch operation area of the mobile phone, the mobile phone responds to the cross-screen operation of the user to generate a cross-screen operation instruction and sends the cross-screen operation instruction to the smart television, and the smart television responds to the received cross-screen operation instruction to execute a channel selection function and display a corresponding channel selection interface for the user to select channels.

Example two: the user has a need to "look back".

The user can input command information of 'huikan' on a virtual keyboard of the mobile phone, the 'huikan' is displayed in an implicit text box corresponding to the virtual keyboard and is synchronously displayed in an information input area of the smart television, and the 'review' two characters are synchronously displayed in the implicit text box of the mobile phone and the information input area of the smart television in response to the selection of the character 'review' corresponding to the 'huikan' by the user. Or the user can select a voice input function on a virtual keyboard of the mobile phone, input 'review' voice information, convert the voice into text information through the function of converting the voice into characters, and synchronously display the 'review' two characters in an implicit text box of the mobile phone and an information input area of the smart television. After a user sees the information input area to display complete instruction information, the touch operation area of the mobile phone is subjected to cross-screen operation, the mobile phone responds to the cross-screen operation of the user to generate a cross-screen operation instruction and sends the cross-screen operation instruction to the smart television, and the smart television responds to the received cross-screen operation instruction to execute a review function and display a corresponding review interface for the user to review.

Example three: the user has a "volume adjustment" requirement.

The user can input instruction information of 'tiaojieyiniang' on a virtual keyboard of the mobile phone, the 'tiaojieyiniang' is displayed in an implicit textbox corresponding to the virtual keyboard and is synchronously displayed in an information input area of the smart television, and in response to the selection of the 'tiaojieyiniang' corresponding to a character 'volume adjustment', two characters of 'volume adjustment' are synchronously displayed in the implicit textbox of the mobile phone and the information input area of the smart television. Or the user can select a voice input function on a virtual keyboard of the mobile phone, input voice information of 'volume adjustment', convert voice into text information through the function of converting voice into characters, and synchronously display the two characters of 'volume adjustment' in an implicit text box of the mobile phone and an information input area of the smart television. After a user sees that the information input area displays complete instruction information, the touch control operation area of the mobile phone carries out screen crossing operation, the mobile phone responds to the screen crossing operation of the user to generate a screen crossing operation instruction and sends the screen crossing operation instruction to the smart television, and the smart television responds to the received screen crossing operation instruction to execute a volume adjusting function and display a corresponding volume adjusting interface for the user to adjust the volume.

According to the technical scheme provided by the embodiment of the application, the first terminal device and the second terminal device can establish communication connection, a cross-screen control interface comprising a touch operation area is displayed on the first terminal device, so that a user can interact with the first terminal device through the touch operation area to generate a cross-screen operation instruction, the operation instruction can be transmitted to the second terminal device side based on the communication connection, the second terminal device executes corresponding functions based on the cross-screen operation instruction, the user can realize cross-screen control on the second terminal device through touch operation of the first terminal device, the cross-screen control is not limited by an external device or a self-contained mouse, keyboard and the like, and the limitation on the use range is not limited, so that the problem that the use control is not flexible when the second terminal device is controlled is solved.

Fig. 2 is a flowchart illustrating a cross-screen control method according to an exemplary embodiment of the present application. The method is applicable to a first terminal device, and as shown in fig. 2, the method includes:

201. when the cross-screen control of the second terminal equipment is needed, a cross-screen control interface is displayed on a display screen, the cross-screen control interface comprises a touch operation area, and the touch operation area corresponds to an information input area displayed on the display screen of the second terminal equipment;

202. responding to cursor positioning operation in the touch operation area, and sending screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal equipment so that the second terminal equipment can position a cursor position in the information input area;

203. responding to an input trigger operation in the touch operation area, displaying the virtual keyboard, responding to an input operation on the virtual keyboard, sequentially sending at least one input atom instruction message to the second terminal device, so that the second terminal device displays the at least one atom instruction message in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction, wherein the cross-screen instruction operation comprises the at least one atom instruction message.

In an optional embodiment, in response to a cursor positioning operation in the touch operation area, sending screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device, so that the second terminal device can position the cursor position in the information input area, which can be implemented by the following manners: responding to the current cursor positioning operation in the touch operation area, when the current cursor positioning operation is the non-first cursor positioning operation in the current cross-screen control process, acquiring screen position change information generated by the current cursor positioning operation relative to the last cursor positioning operation, and sending the screen position change information to the second terminal equipment so that the second terminal equipment can reposition the cursor position according to the screen position change information and the current cursor position in the information input area; when the current cursor positioning operation is the first cursor positioning operation in the current screen-crossing control process, screen position information corresponding to the current cursor positioning operation is obtained, and the screen position information is sent to the second terminal device, so that the second terminal device can display a cursor at an initial cursor position preset in the information input area according to the screen position information.

Further, responding to an input operation on the virtual keyboard, sequentially sending at least one input atom instruction message to the second terminal device, so that the second terminal device displays at least one atom instruction message in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executes a corresponding function according to the cross-screen operation instruction, and the method can be realized by the following modes: responding to input operation on the virtual keyboard, and sequentially recording at least one input atom instruction information into an implicit text box associated with the virtual keyboard; and synchronizing the incremental atomic instruction information and the corresponding incremental type thereof to the second terminal equipment every time the atomic instruction information in the text box changes, so that the second terminal equipment displays the incremental atomic instruction information at the current cursor position in the information input area until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction.

Further, if at least one atom instruction information is a voice instruction information, the atom instruction information of the increment and the increment type corresponding to the atom instruction information of the increment are synchronized to the second terminal device, and the method can be realized by the following steps: and converting the incremental voice instruction information into incremental text instruction information, and synchronizing the incremental text instruction information and the corresponding incremental type thereof to the second terminal equipment.

Further before displaying the cross-screen control interface on the display screen, the method further comprises the following steps: responding to the scanning trigger operation, scanning an information code displayed on a display screen of the second terminal equipment, wherein the information code carries information of the second terminal equipment; and establishing communication connection for the current screen-crossing control with the second terminal equipment according to the information of the second terminal equipment carried in the information code.

Further, the cross-screen control method further comprises the following steps: the method comprises the steps that an application program required for cross-screen control of second terminal equipment is installed and operated on the first terminal equipment in advance, and the application program is adapted to operating system software of the second terminal equipment, which supports the cross-screen control.

The technical scheme provided by the embodiment of the application provides the first terminal equipment which can establish communication connection with the second terminal equipment, displaying a cross-screen control interface comprising a touch operation area on the first terminal equipment, and when the cross-screen control of the second terminal equipment is required, a user can interact with the first terminal equipment through the touch operation area to generate a cross-screen operation instruction, the operation instruction can be transmitted to the second terminal device side based on the communication connection, so that the second terminal device can execute the corresponding function based on the cross-screen operation instruction, therefore, a user can realize cross-screen control on the second terminal device through touch operation of the first terminal device, and the cross-screen control is not limited by external equipment and the use range of a mouse, a keyboard and the like, so that the problem that the use control is not flexible enough when the second terminal device is controlled is solved.

Here, it should be noted that: the cross-screen control method provided by this embodiment can implement the technical solution described in the above-mentioned cross-screen control system-based embodiment, and details are not described here.

Fig. 3 is a flowchart illustrating a cross-screen control method according to an exemplary embodiment of the present application. The method is applicable to a second terminal device, and as shown in fig. 3, the method includes:

301. when the first terminal equipment is required to carry out cross-screen control, displaying an information input area on a display screen, so that the first terminal equipment can display a touch operation area corresponding to the information input area;

302. receiving screen position information or screen position change information, wherein the screen position information or the screen position change information is sent by the first terminal equipment in response to cursor positioning operation in the touch operation area;

303. positioning a cursor position in the information input area according to the screen position information or the screen position change information;

304. sequentially receiving at least one atom instruction message, wherein the at least one atom instruction message is sequentially sent by the first terminal device in response to the input operation on the virtual keyboard;

305. and displaying at least one atom instruction information in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction, wherein the cross-screen operation instruction comprises at least one atom instruction information.

Further, the first terminal device may be a smart phone, and the second terminal device may be a smart television; correspondingly, according to the cross-screen operation instruction, executing corresponding functions, including: when the cross-screen operation instruction is a channel switching instruction, the smart television executes channel switching operation according to the channel switching instruction sent by the smart phone; when the cross-screen operation instruction is a review instruction, the smart television executes a search operation according to a search instruction sent by the smart phone; when the cross-screen operation instruction is a volume adjusting instruction, the smart television executes audio playing operation according to an audio playing instruction sent by the smart phone. The cross-screen operation instruction is used as an exemplary illustration and is not limited to the cross-screen operation instruction.

According to the technical scheme, the communication connection can be established between the second terminal device and the first terminal device, when the second terminal device needs to be controlled in a cross-screen mode, the second terminal device can execute corresponding functions based on the cross-screen operation instruction sent by the first terminal device, and is not limited by external equipment or a mouse, a keyboard and the like which are arranged on the second terminal device to limit the use range.

Fig. 4 is a schematic structural diagram of a terminal device according to an exemplary embodiment of the present application. The terminal device is configured to execute the steps of a cross-screen control method applied to a first terminal device, and as shown in fig. 4, the terminal device includes:

a memory 40a and a processor 40 b; the memory is for storing a computer program, and the processor 40b is coupled to the memory 40a for executing the computer program to implement the steps of:

when the cross-screen control of the second terminal equipment is needed, displaying a cross-screen control interface on a display screen, wherein the cross-screen control interface comprises a touch operation area, and the touch operation area corresponds to an information input area displayed on the display screen of the second terminal equipment; responding to cursor positioning operation in the touch operation area, and sending screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device so that the second terminal device can position the cursor position in the information input area; responding to an input trigger operation in the touch operation area, displaying the virtual keyboard, responding to an input operation on the virtual keyboard, sequentially sending at least one input atom instruction message to the second terminal device, so that the second terminal device displays the at least one atom instruction message in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction, wherein the cross-screen instruction operation comprises the at least one atom instruction message.

Further, the processor 40b is configured to, in response to a cursor positioning operation in the touch operation area, send screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device, so that when the second terminal device positions the cursor position in the information input area, specifically: responding to the current cursor positioning operation in the touch operation area, when the current cursor positioning operation is the non-first cursor positioning operation in the current screen-crossing control process, acquiring screen position change information generated by the current cursor positioning operation relative to the last cursor positioning operation, and sending the screen position change information to the second terminal equipment so that the second terminal equipment can reposition the cursor position according to the screen position change information and the current cursor position in the information input area; when the current cursor positioning operation is the first cursor positioning operation in the current screen-crossing control process, screen position information corresponding to the current cursor positioning operation is obtained, and the screen position information is sent to the second terminal device, so that the second terminal device can display a cursor on an initial cursor position preset in the information input area according to the screen position information.

Further, the processor 40b is configured to respond to an input operation on the virtual keyboard, and sequentially send at least one input atomic instruction information to the second terminal device, so that the second terminal device displays the at least one atomic instruction information in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and when executing a corresponding function according to the cross-screen operation instruction, the processor is specifically configured to: responding to input operation on the virtual keyboard, and sequentially recording at least one input atom instruction information into an implicit text box associated with the virtual keyboard; and synchronizing the incremental atomic instruction information and the corresponding incremental type thereof to the second terminal equipment every time the atomic instruction information in the text box changes, so that the second terminal equipment displays the incremental atomic instruction information at the current cursor position in the information input area until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction.

Further, if at least one atom instruction information is a voice instruction information, the processor 40b is configured to synchronize the atom instruction information of the increment and the corresponding increment type thereof to the second terminal device, and includes:

and converting the incremental voice instruction information into incremental text instruction information, and synchronizing the incremental text instruction information and the corresponding incremental type thereof to the second terminal equipment.

Further, before displaying the cross-screen control interface on the display screen, the processor 40b is further configured to: responding to the scanning trigger operation, scanning an information code displayed on a display screen of the second terminal equipment, wherein the information code carries information of the second terminal equipment; and establishing communication connection for the current screen-crossing control with the second terminal equipment according to the information of the second terminal equipment carried in the information code.

Further, the processor 40b is further configured to: the method comprises the steps that an application program required for cross-screen control of second terminal equipment is installed and operated on the first terminal equipment in advance, and the application program is adapted to operating system software of the second terminal equipment, which supports the cross-screen control.

Further, as shown in fig. 4, the electronic device further includes: communication component 40c, display 40d, power component 40e, audio component 40f, and the like. Only some of the components are schematically shown in fig. 4, and the electronic device is not meant to include only the components shown in fig. 4.

Here, it should be noted that: the terminal device provided in this embodiment may implement the above technical solution described in the cross-screen control system embodiment, and reference may be made to corresponding contents in the above method embodiments for specific implementation principles of each module or unit, which are not described herein again.

Fig. 5 is a schematic structural diagram of a terminal device according to an exemplary embodiment of the present application. The terminal device is configured to execute the steps of a cross-screen control method applicable to a second terminal device, as shown in fig. 5, and includes:

a memory 50a and a processor 50 b; the memory 50a is used for storing a computer program, and the processor 50b is coupled to the memory 50a for executing the computer program to implement the steps of:

when the first terminal equipment is required to carry out cross-screen control, displaying an information input area on a display screen, so that the first terminal equipment can display a touch operation area corresponding to the information input area; receiving screen position information or screen position change information, wherein the screen position information or the screen position change information is sent by the first terminal equipment in response to cursor positioning operation in the touch operation area; positioning a cursor position in the information input area according to the screen position information or the screen position change information; sequentially receiving at least one atom instruction message, wherein the at least one atom instruction message is sequentially sent by the first terminal equipment in response to the input operation on the virtual keyboard; and displaying at least one atom instruction information in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction, wherein the cross-screen operation instruction comprises at least one atom instruction information.

Further, as shown in fig. 5, the electronic device further includes: communication component 50c, display 50d, power component 50e, audio component 50f, and the like. Only some of the components are schematically shown in fig. 5, and it is not meant that the electronic device comprises only the components shown in fig. 5.

An exemplary embodiment of the present application further provides a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to implement the steps in the method described above, and this embodiment is not described in detail again.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A cross-screen control system, comprising: the method comprises the steps that communication connection is established between the first terminal device and the second terminal device, an information input area is displayed on a display screen of the second terminal device, a cross-screen control interface is displayed on the display screen of the first terminal device, and the cross-screen control interface comprises a touch operation area corresponding to the information input area;

the first terminal device is used for responding to cursor positioning operation in the touch operation area and sending screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device; responding to an input trigger operation in the touch operation area, displaying a virtual keyboard, responding to an input operation on the virtual keyboard, and sequentially sending at least one input atom instruction message to the second terminal equipment;

the second terminal device is configured to position a cursor position in the information input region according to the screen position information or the screen position change information sent by the first terminal device, display the at least one atomic instruction information sent by the first terminal device in the information input region according to the cursor position until a complete screen-crossing operation instruction is obtained, and execute a corresponding function according to the screen-crossing operation instruction, where the screen-crossing instruction operation includes the at least one atomic instruction information.

2. A cross-screen control method is suitable for a first terminal device, and is characterized by comprising the following steps:

when cross-screen control is required to be performed on second terminal equipment, displaying a cross-screen control interface on a display screen, wherein the cross-screen control interface comprises a touch operation area, and the touch operation area corresponds to an information input area displayed on the display screen of the second terminal equipment;

responding to cursor positioning operation in the touch operation area, and sending screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device so that the second terminal device can position a cursor position in the information input area;

responding to an input trigger operation in the touch operation area, displaying a virtual keyboard, responding to an input operation on the virtual keyboard, sequentially sending at least one input atom instruction message to the second terminal device, so that the second terminal device displays the at least one atom instruction message in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction, wherein the cross-screen instruction operation comprises the at least one atom instruction message.

3. The method according to claim 2, wherein sending screen position information or screen position change information corresponding to the cursor positioning operation to the second terminal device in response to the cursor positioning operation in the touch operation area, so that the second terminal device positions the cursor position in the information input area, comprises:

responding to the current cursor positioning operation in the touch operation area, when the current cursor positioning operation is the non-first cursor positioning operation in the current cross-screen control process, acquiring screen position change information generated by the current cursor positioning operation relative to the last cursor positioning operation, and sending the screen position change information to the second terminal equipment so that the second terminal equipment can reposition the cursor position according to the screen position change information and the current cursor position in the information input area;

when the current cursor positioning operation is the first cursor positioning operation in the current screen-crossing control process, screen position information corresponding to the current cursor positioning operation is obtained, and the screen position information is sent to the second terminal device, so that the second terminal device can display a cursor at an initial cursor position preset in the information input area according to the screen position information.

4. The method according to claim 2, wherein in response to an input operation on the virtual keyboard, sequentially sending at least one input atomic instruction message to the second terminal device, so that the second terminal device displays the at least one atomic instruction message in the information input region according to the cursor position until a complete cross-screen operation instruction is obtained, and executes a corresponding function according to the cross-screen operation instruction, including:

responding to the input operation on the virtual keyboard, and sequentially recording at least one input atom instruction information into an implicit text box associated with the virtual keyboard;

and synchronizing the incremental atomic instruction information and the corresponding incremental type thereof to the second terminal device whenever the atomic instruction information in the text box changes, so that the second terminal device displays the incremental atomic instruction information at the current cursor position in the information input area until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction.

5. The method of claim 4, wherein if the at least one atomic instruction information is a voice instruction information, synchronizing incremental atomic instruction information and its corresponding incremental type to the second terminal device comprises:

6. The method of any of claims 2-5, further comprising, prior to displaying the cross-screen control interface on the display screen:

responding to a scanning trigger operation, scanning an information code displayed on a display screen of the second terminal device, wherein the information code carries information of the second terminal device;

and establishing communication connection for the current screen crossing control with the second terminal equipment according to the information of the second terminal equipment carried in the information code.

7. The method of any of claims 2-5, further comprising:

and installing and running an application program required for cross-screen control on the second terminal equipment in advance on the first terminal equipment, wherein the application program is adapted to operating system software supporting the cross-screen control of the second terminal equipment.

8. A cross-screen control method is suitable for a second terminal device, and is characterized by comprising the following steps:

when the first terminal equipment is required to carry out cross-screen control, displaying an information input area on a display screen, so that the first terminal equipment can display a touch operation area corresponding to the information input area;

receiving screen position information or screen position change information, wherein the screen position information or the screen position change information is sent by the first terminal equipment in response to cursor positioning operation in the touch operation area;

positioning a cursor position in the information input area according to the screen position information or the screen position change information;

sequentially receiving at least one atom instruction message, wherein the at least one atom instruction message is sequentially sent by first terminal equipment in response to input operation on a virtual keyboard;

and displaying the at least one atom instruction information in the information input area according to the cursor position until a complete cross-screen operation instruction is obtained, and executing a corresponding function according to the cross-screen operation instruction, wherein the cross-screen operation instruction comprises the at least one atom instruction information.

9. A terminal device, implementable as a first terminal device, comprising: a memory and a processor; the memory is adapted to store a computer program, and the processor is coupled to the memory for executing the computer program to implement the steps of the method of any of claims 2-7.

10. A terminal device, implementable as a second terminal device, comprising: a memory and a processor; the memory is configured to store a computer program, and the processor is coupled to the memory and configured to execute the computer program to implement the steps of the method of claim 8.

11. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, causes the processor to carry out the steps of the method of any one of claims 2-7.