CN118317150A

CN118317150A - Screen transmission method, device, equipment and storage medium

Info

Publication number: CN118317150A
Application number: CN202310028073.0A
Authority: CN
Inventors: 罗增伟
Original assignee: Guangzhou Shizhen Information Technology Co Ltd
Current assignee: Guangzhou Shizhen Information Technology Co Ltd
Priority date: 2023-01-09
Filing date: 2023-01-09
Publication date: 2024-07-09

Abstract

The embodiment of the application discloses a screen transfer method, a device, equipment and a storage medium, wherein the screen transfer control instruction is received in a screen transfer state and is used for confirming that at least one application window currently displayed in a desktop picture is used as a first application window; responding to a screen transfer control instruction, and acquiring first picture data and first area information of a first application window from a desktop picture; performing hollowed-out processing on the desktop image according to the first area information to obtain first target desktop data, wherein the resolution of the first target desktop data is lower than that of the first image data; and the first picture data, the first target desktop data and the first region information are sent to the receiving equipment, so that the receiving equipment can fuse the first picture data and the first target desktop data according to the first region information to display, the problem of screen transfer blocking can be solved, the smooth degree of screen transfer is improved, and the user experience is improved.

Description

Screen transmission method, device, equipment and storage medium

Technical Field

The embodiment of the application relates to the technical field of screen transmission, in particular to a screen transmission method, device, equipment and storage medium.

Background

With the development of internet technology, electronic devices are various and have various applications. In some scenarios, the demand of users for portable rewards for content between multiple electronic device display screens is also increasing, and the screen transfer technology can meet the demand of users to a great extent.

With the continuous improvement of the definition requirements of users on the display screen of the electronic device, the resolution of the display screen of the electronic device is also continuously improved, so that most of the electronic devices are high-resolution electronic devices at present. When the screen is transmitted, if the original resolution picture is used for screen transmission without compressing the image quality, the requirements on the performance and the network environment of the sending equipment and the receiving equipment are extremely high. In an actual environment, the screen transmission using the original resolution picture is often easy to generate a clamping phenomenon.

Disclosure of Invention

The screen transfer method, device, equipment and storage medium provided by the embodiment of the application can solve the problem of screen transfer blocking, improve the smooth degree of screen transfer and improve the use experience of users.

In a first aspect, an embodiment of the present application provides a screen transmission method, which is applied to a transmitting device, including:

Receiving a screen transfer control instruction in a screen transfer state, wherein the screen transfer control instruction is used for confirming that at least one application window currently displayed in a desktop picture is used as a first application window;

Responding to the screen transfer control instruction, and acquiring first picture data and first area information of the first application window from the desktop picture;

performing hollowed-out processing on the desktop image according to the first area information to obtain first target desktop data, wherein the resolution of the first target desktop data is lower than that of the first image data;

and sending the first picture data, the first target desktop data and the first area information to receiving equipment so that the receiving equipment fuses the first picture data and the first target desktop data according to the first area information to display.

In a second aspect, an embodiment of the present application provides a screen transmission method, which is applied to a receiving device, and includes:

receiving first picture data, first target desktop data and first area information sent by a sending device, wherein the resolution of the first target desktop data is lower than that of the first picture data;

and fusing the first picture data and the first target desktop data according to the first region information for display.

In a third aspect, an embodiment of the present application provides a screen transmission device, which is applied to a transmitting device, including:

the instruction receiving unit is used for receiving a screen transfer control instruction in a screen transfer state, wherein the screen transfer control instruction is used for confirming that at least one application window currently displayed in a desktop picture is used as a first application window

A window picture obtaining unit, configured to obtain first picture data and first area information of the first application window from the desktop picture in response to the screen transfer control instruction;

The desktop picture obtaining unit is used for carrying out hollowed-out processing on the desktop picture according to the first area information to obtain first target desktop data, wherein the resolution of the first target desktop data is lower than that of the first picture data;

the screen transmission unit is used for transmitting the first picture data, the first target desktop data and the first area information to the receiving equipment so that the receiving equipment can fuse the first picture data and the first target desktop data according to the first area information for displaying.

In a fourth aspect, an embodiment of the present application provides a screen transmitting device, which is applied to a receiving device, including:

A data receiving unit, configured to receive first frame data, first target desktop data, and first region information sent by a sending device, where a resolution of the first target desktop data is lower than a resolution of the first frame data;

And the display unit is used for fusing the first picture data and the first target desktop data according to the first region information for display.

In a fifth aspect, an embodiment of the present application provides a screen transmission device, including:

a display screen, a memory, and one or more processors;

The display screen is used for displaying the first window;

The memory is used for storing one or more programs;

The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the screen passing method as described in the first aspect or the second aspect.

In a sixth aspect, embodiments of the present application provide a storage medium storing computer executable instructions which, when executed by a computer processor, are for performing a screen passing method as described in the first or second aspect.

According to the embodiment of the application, the first picture data and the first area information of the first application window are obtained from the desktop picture in response to the screen transmission control instruction, the first target desktop data with lower resolution than that of the first picture data is obtained by carrying out hollowed-out processing on the desktop picture according to the first area information, and the first picture data, the first target desktop data and the first area information are sent to the ending equipment, so that the technical problem of screen transmission blocking is solved, the resolution of part of screen transmission pictures is reduced, the smooth degree of screen transmission is improved, the probability of blocking is reduced, the use experience of a user is improved, and the receiving equipment fuses the first picture data and the first target desktop data according to the first area information to display, the integrity of picture display is guaranteed, and the use experience of the user is further improved.

Drawings

FIG. 1 is a flowchart of a screen transfer method according to an embodiment of the present application;

FIG. 2 is a diagram of a desktop screen according to an embodiment of the present application;

FIG. 3 is a schematic diagram of an application list according to an embodiment of the present application;

FIG. 4 is a flowchart of a method for performing a hollowed-out processing on a desktop image according to an embodiment of the present application;

FIG. 5 is a flowchart of another method for performing a hollowed-out processing on a desktop image according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a single application window display according to one embodiment of the present application;

FIG. 7 is a schematic diagram of a multi-application window display according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another multi-application window display according to one embodiment of the present application;

FIG. 9 is a flowchart of a screen transfer method after a position of an application window area is changed according to an embodiment of the present application;

FIG. 10 is a flowchart of another screen transfer method according to an embodiment of the present application;

FIG. 11 is a schematic diagram of a second window coordinate provided by an embodiment of the present application;

FIG. 12 is a schematic diagram of a fusion display according to an embodiment of the present application;

Fig. 13 is a schematic structural diagram of a screen transmission device according to an embodiment of the present application;

FIG. 14 is a schematic structural view of another screen transmission device according to an embodiment of the present application;

Fig. 15 is a schematic structural diagram of a screen transmission device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the following detailed description of specific embodiments of the present application is given with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the matters related to the present application are shown in the accompanying drawings. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.

The screen transmission can be understood as realizing display synchronization after the display contents of different electronic devices are mutually transmitted through a network technology, and is commonly used for meeting office work, centralized teaching, daily film observation and the like. The electronic equipment of the screen has the corresponding display resolution, and the higher the resolution of the displayed image is, the more pixels are contained, and the clearer the image is. The sending equipment is the electronic equipment initiating the screen transmission, and the sending equipment sends the corresponding screen transmission data to the other electronic equipment according to the screen transmission instruction, so that the other electronic equipment realizes the display of the corresponding screen transmission data after receiving the screen transmission data. When the screen is transmitted, whether the electronic equipment receiving the screen-throwing data can smoothly display the corresponding screen-throwing data is one of main factors affecting the user experience, and when the screen transmission is blocked, the corresponding activity (conference, teaching or film watching and the like) process of the electronic equipment receiving the screen-throwing data is affected, so that the affected user experience is achieved. In the related art, with the continuous improvement of the definition requirement of users on the display screen of the electronic device, the resolution of the display screen of the electronic device is also continuously improved, so most of the electronic devices are high-resolution devices at present. When the screen is transmitted, if the original resolution picture is used for screen transmission without compressing the image quality, the requirements on the performance and the network environment of the sending equipment and the receiving equipment are extremely high. In an actual environment, the screen transmission using the original resolution picture is easy to cause a clamping phenomenon, and the use experience of a user is affected. In order to avoid the blocking phenomenon, the screen transmission picture is generally compressed to a low resolution picture and then transmitted. However, most of the electronic devices on the market are high-resolution devices, when the high-resolution electronic devices receive the low-resolution screen-transfer images, the low-resolution images are displayed on the display screen of the high-resolution electronic devices in an unclear condition, and the use experience of users is also affected.

For example, in a conference process, different application contents, such as PPT, a browser web page, or a professional tool, are often required to be displayed, when PPT is displayed, extremely high resolution is often not required, and when professional tools (such as multimedia tools like image processing software (Photoshop) or film and television post special effect software (AE)) are displayed, extremely high image quality reduction degree is required, so that the compressed image quality is inconvenient to be projected. The screen transmission in the market can only cut and transmit the image quality, if the original resolution is completely used, a large amount of performance of the transmitting equipment is consumed when the high-definition resolution is not needed for playing the PPT or displaying the webpage and the like, so that the PPT turns pages or the webpage browse is blocked. While all adapt to the compression resolution, a lot of detail is lost when professional content is presented. If the user needs to adjust the resolution, the screen transmission is disconnected when one application needs to be switched, and the transmission is performed after the resolution is adjusted, so that the operation is troublesome.

Based on the above, the embodiments of the present application provide a screen transfer method, apparatus, device, and storage medium, which aim to avoid the situations of screen transfer blocking and unclear display by reducing the resolution of a part of screen transfer pictures during screen transfer.

The screen transmission method provided by the embodiment of the application can be executed by screen transmission equipment, the screen transmission equipment can be realized in a software and/or hardware mode, and the screen transmission equipment can be formed by two or more physical entities or one physical entity. Currently, the screen-transmitting device may be an electronic device such as an interactive tablet, a tablet computer, a smart television, a learning machine, a screen transmitter or a mobile phone.

In one embodiment, the pass-through device is installed with at least one type of operating system, which may be Androi d systems, wi ndows systems, li nux systems, macOS systems, ios systems, etc. The pass-through device may install at least one application under the operating system. The application program can be an application program of an operating system, and also can be installed as an application program downloaded from a third party device or a server. For example, the screen-transmitting device is installed with an application program capable of transmitting a screen, and the application program can be understood as an application client for transmitting the screen, and the application client can also have interaction functions such as a screen-throwing file or a screen-throwing video picture. In practical applications, the name of the application program is the same as the application client for screen transfer in the present disclosure, as long as the application program realizes the above functions.

The screen transfer device is further provided with at least one display screen (also denoted display). When the display screen has a touch function, the display screen may be a capacitive touch display screen, a resistive touch display screen, an infrared touch display screen, and/or an electromagnetic touch display screen. The user can control the screen transmission equipment in a mode of touching the display screen by a finger or a touch pen. In addition, the screen transmission equipment can be connected with external equipment such as a mouse and a keyboard, and a user can control the screen transmission equipment in a mode of operating the external equipment.

The screen transmission equipment is also provided with an audio recording device (such as a microphone), and the sound content of the screen transmission equipment can be collected through the audio recording device. The sound content may carry corresponding data information. It should be noted that the audio input device may be an external device, and after the external device establishes connection with the screen transmission device, the external device may work based on the control of the screen transmission device, so as to collect the sound content.

The screen transmission device is also provided with a communication module, and the communication module is used for realizing a communication function, for example, the screen transmission device performs data transmission with other electronic devices through the communication module. For another example, the screen transmission device performs data transmission with the server through the communication module. In a screen transmission scene, the screen transmission equipment can receive screen throwing data transmitted by other electronic equipment based on the communication module, and forwards the screen throwing data to another electronic equipment through the communication module, particularly, in a scene requiring multi-person communication such as a meeting, the screen transmission equipment can be used as interaction equipment to realize functional requirements in the multi-person communication scene, for example, in the meeting scene, the screen transmission equipment realizes that one electronic equipment and target electronic equipment (such as interaction flat-panel of a meeting room, electronic equipment of a mobile terminal and the like) throw the screen, so that content synchronous sharing is realized.

In an embodiment, each electronic device participating in screen transmission may be used as a screen transmission device, where the screen transmission device may be divided into a screen transmission device at a transmitting device end and a screen transmission device at a receiving device end. The screen transmission equipment of the transmitting equipment end and the screen transmission equipment of the receiving equipment end are used for carrying out screen casting through a screen transmitter. In the screen transmission process, each screen transmission device can realize the screen transmission method provided by the embodiment of the application.

Fig. 1 is a flowchart of a screen transmission method according to an embodiment of the present application, and referring to fig. 1, the screen transmission method is applied to a transmitting device, and includes:

s101, receiving a screen transfer control instruction in a screen transfer state, wherein the screen transfer control instruction is used for confirming that at least one application window currently displayed in a desktop picture is used as a first application window.

The first application window may be a currently displayed application window, such as a PPT program window, a browser web page window, or a professional tool window, where the professional tool includes a multimedia tool such as image processing software (Photoshop) or film and television post special effect software (AE). Wherein, a window is understood as a user interface presented in the form of a window that can be viewed or interacted with by a user. A desktop screen is understood to mean all the displayed content on the display screen of the transmitting device, such as desktop background, icons, application windows, etc. The desktop screen may be set by the user in the transmitting device setting function, and thus, the content of the desktop screen may be unchanged or changed. For example, the displayed PPT screen or browser web screen is set as a desktop screen, and the corresponding professional tool window is set as a first application window.

Before the screen transfer, a communication connection between the transmitting device and the receiving device needs to be established. In general, a corresponding screen transmitting code is displayed on a display screen corresponding to the receiving device, the transmitting device receives the screen transmitting code, and analysis processing is performed according to the screen transmitting code, so as to obtain a I P address of the corresponding receiving device. The transmitting device establishes a communication connection with the receiving device according to the I P address.

After the communication connection between the transmitting device and the receiving device is established, the screen transfer operation can be performed. The transmitting equipment receives a screen transmission instruction, and responds to the screen transmission instruction, and intercepts desktop images frame by frame to obtain a first desktop image. The resolution of the first desktop image is preset first resolution. Based on the fact that most electronic devices are high-resolution electronic devices, the resolution of the corresponding first desktop picture is a high-resolution picture, for example, the resolution is 4K or 8K. When the corresponding application window is not opened, the desktop image generally displays the desktop background and the corresponding icon, and the desktop image can be displayed clearly under the lower resolution, so that the first desktop image can be subjected to image quality processing according to the preset second resolution, and target desktop data can be obtained. The preset second resolution is lower than the preset first resolution, so that the image quality of a desktop picture is compressed, and the transmission pressure of subsequent screen data is reduced. The preset second resolution may be set according to the actual needs of the user, for example, 1080p. And sending the target desktop data to corresponding receiving equipment so as to enable the receiving equipment to display according to the target desktop data. Through carrying out the image quality compression to the desktop picture, alleviateed the transmission pressure of passing screen data, guaranteed the complete demonstration of desktop picture simultaneously also for pass the delay phenomenon such as card dun can not appear in the screen, promote user's use experience.

Fig. 2 is a schematic diagram of a desktop screen according to an embodiment of the present application, referring to fig. 2, after a communication connection between a sending device and a receiving device is established, a desktop screen on a display screen of the sending device is shown in fig. 2, and the desktop screen displayed on the display screen of the sending device is a screen with a preset first resolution, for example, a screen with a resolution of 4K. The direct transmission of 4K pictures during screen transmission may lead to jamming, and therefore, the transmitted desktop pictures need to be compressed in image quality, so that the resolution is reduced, and the transmission pressure of screen transmission data is reduced. Based on the fact that the desktop picture is the desktop background and the icon when the application window is not opened, an unclear effect is not visually generated after the image quality is reduced, and therefore the display of the desktop picture with reduced resolution on the corresponding receiving device is not influenced. The sending device inputs a screen-passing instruction according to the virtual key of 'start screen-passing' on the display screen clicked by the user, and determines a corresponding preset second resolution, for example 1080p, according to the 'screen-passing quality' option selected by the user. And the sending equipment responds to the screen transmission instruction and intercepts the desktop images frame by frame to obtain a first desktop image. The resolution of the first desktop is a preset first resolution (e.g., 4K). And performing image quality processing on the first desktop image according to a preset second resolution (1080 p) to obtain target desktop data. And sending the target desktop data to corresponding receiving equipment so as to enable the receiving equipment to display according to the target desktop data. Through carrying out the image quality compression to the desktop picture, alleviateed the transmission pressure of passing screen data, guaranteed the complete demonstration of desktop picture simultaneously also for pass the delay phenomenon such as card dun can not appear in the screen, promote user's use experience.

In the screen transmission state, when the corresponding application program window is displayed based on the actual requirement, the sending equipment receives the screen transmission control instruction to determine that at least one application window currently displayed in the desktop picture is used as a first application window for subsequent screen transmission of the first application window.

And triggering and displaying an application list in the screen transmission state, wherein the application list displays an application window identifier currently displayed in the desktop screen. And receiving a selection operation of at least one identifier in the application list, and taking the application window determined by the selection operation as a first application window. Fig. 3 is a schematic view of an application list provided in an embodiment of the present application, and referring to fig. 3, an application list is displayed with application window identifiers currently displayed in a desktop, where an application a window, an application B window, an application C window, and the like in fig. 3 are all application window identifiers. At least one identified selection operation is received in the application manifest, for example, an application a window is selected, and the selected application window a is taken as a first application window.

It should be noted that, by selecting the identifiers of the multiple application windows, for example, selecting the application a window and the application B window, both the application a window and the application B window are the first application window.

It should be noted that, when selecting the application window identifier, the resolution of the corresponding application window is also required to be selected, for example, as shown in fig. 3, the "original resolution screen projection" option corresponding to the corresponding application window a is selected, if the "original resolution screen projection" option is selected, the image quality of the corresponding application window picture is not processed subsequently, and the screen is transmitted directly according to the original resolution picture of the application window. If the 'original resolution screen projection' option is not checked, then the picture of the corresponding application window is required to be processed in image quality later, so that the picture of the application window is transmitted after the resolution of the picture of the application window is the same as that of the desktop picture.

And receiving a selection operation of at least one identifier in the application list, and taking the application window determined by the selection operation as a first application window. And generating a corresponding screen transmission control instruction according to the selection operation of at least one identifier, and receiving the screen transmission control instruction by the transmitting equipment in a screen transmission state to confirm that at least one application window currently displayed on the desktop picture is used as a first application window.

By performing image quality compression processing on the desktop image, the target desktop data with lower resolution is obtained, and the target desktop data is transmitted to the receiving equipment for display, so that the transmission pressure of the screen transmission data is reduced, and the screen transmission flow degree is improved. And selecting an application window in a screen transmission state, determining at least one application window currently displayed on the desktop screen as a first application window, and determining the first application window and the screen resolution of the subsequent screen transmission of the application window, so that the subsequent screen transmission of the desktop screen and the first application window can be respectively acquired, further screen transmission of different image quality is performed, the screen transmission data transmission pressure is reduced, and the screen transmission smoothness is improved.

S102, responding to the screen transfer control instruction, and acquiring first picture data and first area information of the first application window from the desktop picture.

The first application window may be a currently displayed application window, such as a PPT program window, a browser web page window, or a professional tool window, where the professional tool includes a multimedia tool such as image processing software (Photoshop) or film and television post special effect software (AE). And generating a corresponding screen transmission control instruction according to the selection operation of at least one identifier, receiving the screen transmission control instruction by the transmitting equipment in a screen transmission state, and responding to the screen transmission control instruction to acquire first picture data and first area information of a first application window from a desktop picture. The first area information is window coordinates, namely pixel coordinates of a first application window on a display screen of the sending device. For example, the window coordinates of the application a window on the transmitting device display screen are ((800, 650), (700)), the window coordinates representing the upper left-hand corner pixel coordinates and the lower right-hand corner pixel coordinates of the application window. The area of the corresponding first application window can be obtained according to the first area information, namely, the area of the area covered by the first application window can be obtained through calculation according to the window coordinates.

It should be noted that, when the first application window is a plurality of application windows, for example, the first application window is an application a window and an application B window, the image data acquisition is performed on the application a window and the application B window respectively, so as to obtain corresponding first image data.

The screen transmission instruction generated based on the selection operation of the corresponding window identifier is used for acquiring the first picture data and the first area information of the first application window, so that the area and the area position of the corresponding first application window can be determined, preparation is further provided for separating the desktop picture from the picture data of the first application window, and a coordinate basis is provided for displaying the first picture data by the receiving equipment.

And S103, performing hollowed-out processing on the desktop image according to the first area information to obtain first target desktop data, wherein the resolution of the first target desktop data is lower than that of the first image data.

The first application window may be a currently displayed application window, such as a PPT program window, a browser web page window, or a professional tool window, or the like. A desktop screen may be understood as all display content of a display screen of a transmitting device, such as desktop background, icons, application windows, and the like. Based on the fact that the first application window is an application program window, the requirement on image quality is high when part of application program windows are displayed, if the image quality of the images of the first application window is compressed, the situation that the images of the subsequent receiving equipment are unclear when the images are displayed can be caused, and therefore user experience is affected. Therefore, for the application window with the image quality requirement, when the user performs the selection operation based on at least one application window identifier, the user can pick up the corresponding original resolution screen projection option, so that the corresponding first application window needs to perform the original resolution screen projection, wherein the original resolution is mostly high resolution, for example, 4K or 8K. Therefore, the desktop picture and the picture of the first application window can be processed separately, the desktop picture is subjected to picture quality compression, and the picture of the first application window is not subjected to picture quality processing, so that the picture quality of the first application window is kept, the data quantity of the whole picture data is reduced, and the transmission pressure of the screen transmission data is reduced.

In order to further reduce the data volume of the overall picture data, the desktop picture can be hollowed out according to the first area information so as to remove the picture area corresponding to the corresponding first application window in the desktop picture, thereby reducing the data volume of the desktop picture. And carrying out data processing according to the hollowed-out desktop picture to obtain first target desktop data. The resolution ratio of the first target desktop data is lower than that of the first picture data, and the picture quality compression of the desktop picture is realized, so that the data volume of the whole picture is reduced, the transmission pressure of the screen transmission data in the subsequent screen transmission process is reduced, and the fluency of the product is improved.

The present embodiment provides a method for performing a hollowed-out processing on a desktop image, and fig. 4 is a flowchart of a method for performing a hollowed-out processing on a desktop image according to an embodiment of the present application, and referring to fig. 4, the method for performing a hollowed-out processing on a desktop image includes:

s1031, responding to the screen transfer control instruction, and acquiring a desktop image to obtain a first desktop image, wherein the resolution of the first desktop image is a preset first resolution.

And generating a corresponding screen transmission control instruction according to the selection operation of at least one identifier, receiving the screen transmission control instruction by the transmitting equipment in a screen transmission state, and responding to the screen transmission control instruction to acquire the desktop picture to obtain a first desktop picture. The first desktop picture is an original resolution picture, typically a high resolution picture, e.g., 4K or 8K in resolution. The preset first resolution may be understood as the original resolution, typically the high resolution.

S1032, performing image quality processing on the first desktop image according to a preset second resolution, so as to obtain a target desktop image, wherein the preset second resolution is lower than the preset first resolution.

Based on the fact that the preset first resolution is high resolution, the resolution of the first desktop picture is the preset first resolution, if the first desktop picture is directly projected, requirements on performance and network environment of sending equipment and receiving equipment are extremely high, and a clamping phenomenon is likely to occur when screen transmission is achieved, so that the first desktop picture needs to be compressed and then transmitted, and the projected data size can be effectively reduced. Therefore, the first desktop picture can be subjected to image quality processing according to the preset second resolution, and the target desktop picture is obtained. The predetermined second resolution is lower than the predetermined first resolution. The specific value of the preset second resolution may be set according to actual needs, for example, the preset second resolution is 1080p in this embodiment.

S1033, performing hollowed-out processing on the target desktop picture according to the first area information to obtain the first target desktop data.

In order to further reduce the data volume of the overall picture data, the target desktop picture can be hollowed out according to the first area information so as to remove the picture area corresponding to the corresponding first application window in the desktop picture, thereby reducing the data volume of the desktop picture. And carrying out data processing according to the hollowed target desktop picture to obtain first target desktop data. The resolution of the first target desktop data is preset second resolution, is lower than the original resolution (preset first resolution) of the desktop picture, and realizes the image quality compression of the desktop picture, so that the data volume of the whole picture is reduced, the transmission pressure of the screen data in the subsequent screen transmission process is reduced, and the product fluency is improved.

In this embodiment, another implementation manner of performing a hollowed-out processing on a desktop image is provided, and fig. 5 is a flowchart of another method for performing a hollowed-out processing on a desktop image according to an embodiment of the present application, and referring to fig. 5, the method for performing a hollowed-out processing on a desktop image includes:

S1034, determining a first area of the first application window according to the first area information.

And generating a corresponding screen transmission control instruction according to the selection operation of at least one identifier, receiving the screen transmission control instruction by the transmitting equipment in a screen transmission state, and responding to the screen transmission control instruction to acquire first picture data and first area information of a first application window from a desktop picture. The first area information is window coordinates, namely pixel coordinates of a first application window on a display screen of the sending device. And obtaining the first area of the corresponding first application window according to the first area information.

S1035, when the first area exceeds a preset first threshold value, performing image quality processing on the desktop picture according to a preset third resolution to obtain a second desktop picture.

Judging whether the first area covered by the first application window exceeds a preset first threshold value, and if the first area covered by the first application window exceeds the preset first threshold value, carrying out image quality processing on the desktop picture according to a preset third resolution to obtain a second desktop picture, wherein the preset first threshold value is three quarters of the display screen of the transmitting equipment. Wherein the predetermined third resolution is lower than the predetermined second resolution, for example 720p, 1080p. When the area of the first application window exceeds three fourths of the display screen, the desktop screen is further compressed, so that the resolution of the desktop screen is further reduced. And if the area of the first area covered by the first application window does not exceed the preset first threshold value, performing image quality processing on the desktop picture according to the preset second resolution to obtain a target desktop picture.

In an embodiment, a transmitting device receives a screen transfer control instruction in a screen transfer state, and obtains a first desktop image by responding to the screen transfer control instruction. The first desktop picture is an original resolution picture, typically a high resolution picture, e.g., 4K or 8K in resolution. The preset first resolution may be understood as the original resolution, typically the high resolution. And performing image quality processing on the first desktop picture according to the preset second resolution to obtain a target desktop picture. The predetermined second resolution is lower than the predetermined first resolution. The specific value of the preset second resolution may be set according to actual needs, for example, the preset second resolution is 1080p in this embodiment. After the target desktop picture is obtained, judging whether the first area covered by the first application window is more than a preset first threshold value, and if the first area covered by the first application window is more than the preset first threshold value, carrying out image quality processing on the target desktop picture to obtain a second desktop picture, wherein the preset first threshold value is assumed to be three quarters of the display screen of the sending equipment. If the area of the first area covered by the first application window does not exceed the preset first threshold value, image quality processing is not needed for the target desktop picture.

S1036, performing hollowed-out processing on the second desktop picture according to the first area information to obtain the first target desktop data.

And when the area of the first area exceeds a preset first threshold value, performing image quality processing on the desktop picture according to a preset third resolution ratio, after obtaining a second desktop picture, performing hollowed-out processing on the area of the first application window corresponding to the second desktop picture according to the first area information, obtaining a hollowed-out area, and replacing the hollowed-out area with blank pixels. And carrying out data processing on the second desktop picture subjected to the hollowed-out processing to obtain first target desktop data.

Fig. 6 is a schematic diagram of displaying a single application window according to an embodiment of the present application, referring to fig. 6, there is only one application a window in a desktop screen, a sending device obtains first screen data and first area information of the application a window from the desktop screen in response to a screen transfer control instruction, and performs a hollowed-out process on the desktop screen according to the first area information of the application a window to obtain a hollowed-out area a, and replaces the hollowed-out area a with blank pixels to obtain first target desktop data. The resolution of the first target desktop data is lower than the resolution of the first picture data of the application a window.

Fig. 7 is a schematic diagram of multi-application window display provided in an embodiment of the present application, and referring to fig. 7, an application a window and an application B window are displayed in a desktop screen, where there is no overlapping area between the two windows, and a sending device obtains first screen data and first area information of the application a window and the application B window from the desktop screen respectively in response to a screen transfer control instruction. And carrying out hollowed-out processing on the desktop picture according to the first area information of the application A window to obtain a hollowed-out area a, and replacing the hollowed-out area a with blank pixels. And carrying out hollowed-out processing on the desktop picture according to the first area information of the application B window to obtain a hollowed-out area B, and replacing the hollowed-out area B with blank pixels. And obtaining corresponding first target desktop data according to the desktop picture hollowed out the area a and the area b.

Fig. 8 is another multi-application window display schematic diagram provided in an embodiment of the present application, and referring to fig. 8, an application a window and an application B window are displayed in a desktop screen, where an overlapping area exists between the two windows, and a sending device obtains first screen data and first area information of the application a window and the application B window from the desktop screen respectively in response to a screen transfer control instruction. And carrying out hollowed-out processing on the desktop picture according to the first area information of the application A window to obtain a hollowed-out area a, and replacing the hollowed-out area a with blank pixels. And carrying out hollowed-out processing on the desktop picture according to the first area information of the application B window to obtain a hollowed-out area B, and replacing the hollowed-out area B with blank pixels. And obtaining corresponding first target desktop data according to the desktop picture hollowed out the area a and the area b.

It should be noted that each application window currently displayed corresponds to a set of first screen data and first area information.

By the aid of the method, the area corresponding to the first application window in the desktop picture is hollowed, so that the data size of the desktop picture is reduced, the data size of the whole picture is reduced, the data size of screen transmission data is reduced, and screen transmission is smoother.

And S104, the first picture data, the first target desktop data and the first area information are sent to receiving equipment, so that the receiving equipment fuses the first picture data and the first target desktop data according to the first area information to display.

The screen transmission can be understood as realizing display synchronization after the display contents of different electronic devices are mutually transmitted through a network technology, so that the screen projection data can be understood as display content data which needs to be synchronously displayed during screen transmission. The screen throwing data is sent to the paired receiving device through the sending device initiating the screen throwing. The first picture data, the first target desktop data and the first area information are obtained through the steps, and the screen projection data set is the first picture data, the first target desktop data and the first area information. The sending device sends the first picture data, the first target desktop data, the first area information and other screen throwing data to the receiving device, so that the receiving device fuses the first picture data and the first target desktop data according to the first area information to display, and screen transmission is achieved.

In an embodiment, when the first area of the first application window is the area of the display screen of the sending device, that is, when the first application window is full-screen, obtaining of the desktop image is stopped, and the first image data and the first area information are sent to the receiving device, so that the receiving device can display the first image data according to the first area information.

After the sending device sends the first picture data, the first target desktop data and the first area information to the receiving device, so that the receiving device fuses the first picture data and the first desktop data according to the first area information to display, the first application window may be stretched or moved according to actual requirements so as to change the covering position of the first application window, and therefore the covering position of the first application window needs to be continuously monitored.

The present embodiment provides a screen transmission implementation manner after the position of the application window area is changed, fig. 9 is a flowchart of a screen transmission method after the position of the application window area is changed, and referring to fig. 9, the screen transmission method includes:

S1041, receiving a window change instruction, and responding to the window change instruction, changing the region position of the first application window.

When the coverage position of the first application window changes, the sending equipment receives the window change instruction, and responds to the window change instruction, the area position of the first application window is changed. The window change instruction comprises a window telescopic instruction and a window moving instruction. And changing the area and the area position of the first application window according to the window stretching instruction and/or the window moving instruction.

S1042, obtaining second picture data and second region information of a first application window after the region position is changed, wherein the resolutions of the first picture data and the second picture data are preset first resolutions.

And acquiring second picture data and second area information of the first application window after the area position is changed. The resolution of the second picture data is the same as that of the first picture data, and the first picture data and the second picture data are preset first resolution. The second area information is the window coordinates of the first application window after the area position is changed, namely the pixel coordinates of the first application window on the display screen of the sending device after the area position is changed.

S1043, determining a second area of the first application window according to the second area information.

And determining the second area of the first application window after the change of the area position according to the second area information. The second region information is the window coordinates of the first application window after the region position is changed, namely the pixel coordinates of the first application window on the display screen of the sending device after the region position is changed, and the area of the first application window, namely the second region area, can be obtained according to the pixel coordinates of the first application window.

S1044, when the second area exceeds a preset first threshold, performing image quality processing on the desktop image according to a preset third resolution to obtain a second desktop image, wherein the resolution of the desktop image is a preset first resolution, and the preset third resolution is lower than the preset first resolution.

Judging whether the area of the second area exceeds the first threshold value, and if the area of the second area exceeds the first threshold value, performing image quality processing on the desktop picture according to a preset third resolution to obtain a second desktop picture. The desktop picture is of a preset first resolution, the preset third resolution is lower than the preset first resolution, and the preset third resolution is lower than the preset second resolution. And if the area of the second area does not exceed the first threshold value, performing image quality processing on the desktop picture according to a preset second resolution to obtain a target desktop picture.

It should be noted that the first threshold may be set according to actual situations. For example, it may be assumed that the first threshold is three-fourths of the display screen area of the transmitting device, and when the second area exceeds three-fourths of the display screen area, the image quality of the desktop screen is further reduced by performing the image quality processing at the third resolution that is lower than the first resolution.

S1045, performing hollowed-out processing on the second desktop picture according to the second area information to obtain second target desktop data.

And when the area of the second area exceeds the first threshold, carrying out hollowed-out processing on the second desktop picture according to the second area information to obtain second target desktop data. And when the area of the second area does not exceed the first threshold, performing hollowed-out processing on the target desktop picture according to the second area information to obtain first target desktop data. The specific hollowed-out processing manner is the same as the above step S103, and will not be described here again.

S1046, the second picture data, the second target desktop data and the second area information are sent to a receiving device, so that the receiving device fuses the second picture data and the second target desktop data according to the second area information to display.

After the second picture data, the second target desktop data and the second area information are obtained through the steps, the sending device sends the second picture data, the second target desktop data and the second area information to the receiving device, so that the receiving device fuses the second picture data and the second target desktop data according to the second area information to display, and screen transmission is achieved.

For example, in a meeting application scene, the original resolution is transmitted aiming at an application which needs high-definition display by a user, other pictures are transmitted with compressed quality, and meanwhile, the user does not need to disconnect a screen transmission for switching again, so that the smooth display effect of the meeting is met. For example, setting image processing software (Photoshop) as an original resolution screen projection application, setting an image processing software (Photoshop) display window as a first application window, setting a conference play display PPT window as a corresponding desktop picture, performing image quality processing on the picture content of the displayed PPT window according to a preset second resolution or a preset third resolution to obtain first target desktop data, displaying the picture of the corresponding image processing software (Photoshop) display window according to the original resolution, not performing image quality processing, obtaining first picture data, and obtaining first area information corresponding to the image processing software (Photoshop) display window. The sending device sends the first target picture data, the first picture data and the first area information to the receiving device, so that the receiving device only consumes low performance when playing the displayed PPT, and in the display process, when an image processing software (Photoshop) display window is opened, the image processing software (Photoshop) display window can display high definition with original resolution and high performance, and a user does not need to manually switch the resolution.

In an embodiment, after determining the second area of the first application window frame according to the second area information, determining whether the second area reaches a second threshold, where the second threshold may be a display screen area, that is, determining whether the first application window is full screen. And if the second area reaches a second threshold value, stopping acquiring the desktop picture, and sending the second picture data and the second area information to the receiving equipment so that the receiving equipment can display the second picture data according to the second area information.

By monitoring the covering position of the first application window, the image quality processing and the hollowed-out processing of the corresponding desktop image can be flexibly changed when the covering position of the first application window is changed, so that the transmission of the image data with different resolutions of the desktop image and the first application image can be realized after the change, the integrity of the whole image is ensured, and the smoothness of the screen transmission is improved on the basis of not affecting the appearance of a user.

In one embodiment, the selection operation and the selection order for at least one identifier are received in the application list, and the application window determined by the selection operation is used as the first application window. And responding to the screen transfer control instruction, and sequentially acquiring first picture data and first area information of the first application window from the desktop picture according to the selection order. And carrying out hollowed-out processing on the desktop picture according to the first area information to obtain first target desktop data. The specific steps of the hollowed-out processing are the same as the step S103, and are not described herein. And sequentially sending the corresponding first picture data to the receiving equipment according to the selection order, and simultaneously sending the first target desktop data and the first area information to the receiving equipment so that the receiving equipment fuses the first picture data and the first target desktop data according to the order of the first area information and the received first picture data for displaying.

For example, referring to fig. 3 and 8, as shown in fig. 3, in the application list, the user sequentially selects the application a window and the application B window for screen projection, and the transmitting device receives a selection operation and a selection order for the application a window identifier and the application B window identifier, where the selection order is to select the application a window first and then select the application B window. And taking the application A window and the application B window determined by the selection operation as first application windows. And responding to the screen transfer control instruction, acquiring first picture data and first area information of the application A window from the desktop picture according to the selection order, and then acquiring first picture data and first area information of the application B window from the desktop picture. And carrying out hollowed-out processing on the desktop picture according to the first area information to obtain first target desktop data. The specific steps of the hollowed-out processing are the same as the step S103, and are not described herein. According to the selection order, the first picture data of the application A window is sent to the receiving device, and then the first picture data of the application B window is sent to the receiving device, so that the receiving device receives the first picture data of the application A window first, and then receives the picture data of the application B window. The sending device sends the first target desktop data and the first area information to the receiving device, so that the receiving device fuses the first picture data of the application A window, the first picture data of the application B window and the first target desktop data according to the sequence of the first area information and the received first picture data to display.

According to the method, the first picture data and the first area information of the first application window are obtained from the desktop picture in response to the screen transmission control instruction, the first target desktop data with lower resolution than that of the first picture data is obtained by carrying out hollowed-out processing on the desktop picture according to the first area information, the first picture data, the first target desktop data and the first area information are sent to the ending equipment, the technical problem of screen transmission blocking is solved, the resolution of part of screen transmission pictures is reduced, the smooth degree of screen transmission is improved, the probability of blocking is reduced, and therefore user experience is improved.

Fig. 10 is a flowchart of another screen transmission method according to an embodiment of the present application, where the screen transmission method is used by a receiving device, and includes:

S201, receiving first picture data, first target desktop data and first area information sent by a sending device, wherein the resolution of the first target desktop data is lower than that of the first picture data.

The screen transmission can be understood as realizing display synchronization after the display contents of different electronic devices are mutually transmitted through a network technology, so that the screen projection data can be understood as display content data which needs to be synchronously displayed during screen transmission. The screen throwing data is sent to the paired receiving device through the sending device initiating the screen throwing. The sending device obtains the first picture data, the first target desktop data and the first area information as a screen projection data set. The transmitting device transmits the screen projection data to the receiving device, and the receiving device receives the screen projection data such as the first picture data, the first target desktop data, the first area information and the like transmitted by the transmitting device. As can be seen from the above steps S101 to S104, the resolution of the corresponding first target desktop data is lower than the resolution of the first frame data.

S202, fusing the first picture data and the first target desktop data according to the first region information for display.

And determining window coordinates of the first application window on the desktop picture according to the first area information, and determining first window coordinates of the picture of the first picture data on the picture corresponding to the first target desktop data according to the ratio of the original resolution of the desktop picture to the resolution (such as the preset first resolution or the preset second resolution) of the first target desktop data and the window coordinates. For example, the original resolution of the desktop picture is 4K, the preset first resolution is 1080p, the desktop picture is processed according to the preset first resolution to obtain a first target desktop picture, a change coefficient is obtained according to the ratio of the preset first resolution 1080p to the original resolution of 4K, and a corresponding first window coordinate is obtained by multiplying the window coordinate of the first application window on the desktop picture by the change coefficient. And determining a first window coordinate according to the first region information, wherein the first window coordinate is a pixel coordinate of the first picture data on a desktop picture corresponding to the first target desktop data. And determining a second window coordinate according to the first window coordinate and the ratio of the first target desktop data to the resolution of the display screen of the receiving device, wherein the second window coordinate is the pixel coordinate of the first picture data on the display screen of the receiving device. For example, a change coefficient is determined according to a ratio of the resolution of the first frame data to the resolution of the display screen of the receiving device, and a second window coordinate is obtained according to a product of the first window coordinate and the change coefficient.

For example, fig. 11 is a schematic diagram of a second window coordinate provided in an embodiment of the present application, referring to fig. 6 and 11, a first window coordinate may be determined according to the first area information, and as shown in fig. 6, assuming that the resolution of the desktop screen corresponding to the first target desktop data is 1080p (1920×1080), the window coordinate of the application a window in the desktop screen is ((800,190), (1700,825)), where the window coordinate represents the pixel coordinate of the upper left corner and the pixel coordinate of the lower right corner of the application window. The receiving device determines a change coefficient according to the ratio of the resolution of the first target desktop data to the resolution of the display screen of the receiving device, for example, the resolution of the first target desktop data is 1080p (1920×1080), the resolution of the display screen of the receiving device is 4K (4096×2960), the corresponding change coefficient is determined according to the ratio of 4K (4096×2960) to 1080p (1920×1080), and then the first window coordinate is multiplied by the change coefficient to obtain a second window coordinate, wherein the second window coordinate is a pixel coordinate of the first picture data on the display screen of the receiving device. At this time, the second window coordinates corresponding to the first screen data in fig. 11 are ((1704,380), (3627,1650)).

And according to the ratio of the resolution of the first target desktop data to the resolution of the display screen of the receiving device, performing pixel conversion on the first target desktop data to obtain third target desktop data. And performing pixel conversion on the first picture data according to the ratio of the resolution of the first picture data to the resolution of the display screen of the receiving device to obtain third picture data. And displaying the third target desktop data to obtain a third desktop picture. And fusing the third picture data to the coordinate position corresponding to the third desktop picture according to the second window coordinate, and displaying the corresponding third picture data in sequence according to the sequence of receiving the first picture data.

For example, when the first application window is a single window during screen transfer, referring to fig. 6 and 11, a second application window A1 may be obtained by displaying according to the third screen data, and the second application window A1 is displayed by being covered on the second window coordinate position corresponding to the third desktop screen.

For example, fig. 12 is a schematic diagram of a fusion display provided in an embodiment of the present application, and when a first application window is a plurality of windows during screen transfer, referring to fig. 8 and fig. 12, a second application window A1 and a second application window B1 may be obtained by displaying according to third frame data. As shown in fig. 8, because there is an overlapping area between the corresponding application a window and the corresponding application B window on the display screen of the sending device, when the second application window A1 and the second application window B1 are overlaid on the second window coordinate positions corresponding to the third desktop screen for display, the corresponding second application window A1 and the corresponding second application window B1 also have an overlapping area, so that the corresponding second application window A1 and the corresponding second application window B1 can be displayed sequentially according to the order in which the first screen data is received. Assuming that the first picture data corresponding to the second application window A1 is received first, the second application window A1 is displayed first, and then the second application window B1 is displayed, so that the second application window B1 is at the upper layer of the second application window A1.

Above-mentioned, through receiving first picture data, first target desktop data and first regional information to according to first regional information fusion resolution ratio different first picture data and first target desktop data, thereby realized the display of resolution ratio different picture data, improved the smooth degree of passing the screen, reduced the probability that the card was duned appears, thereby promoted user's use experience.

Fig. 13 is a schematic structural diagram of a screen transmission device according to an embodiment of the present application. Referring to fig. 13, the screen transmission device provided in this embodiment is applied to a transmitting device, and specifically includes: an instruction receiving unit 11, a window screen acquiring unit 12, a desktop screen acquiring unit 13, and a screen transmitting unit 14.

The instruction receiving unit 11 is configured to receive a screen transfer control instruction in a screen transfer state, where the screen transfer control instruction is configured to confirm that at least one application window currently displayed in a desktop screen is used as a first application window

A window screen acquiring unit 12 configured to acquire first screen data and first area information of the first application window from the desktop screen in response to the screen transfer control instruction;

A desktop image obtaining unit 13, configured to perform a hollowed-out process on a desktop image according to the first area information, to obtain first target desktop data, where a resolution of the first target desktop data is lower than a resolution of the first image data;

And the screen transfer unit 14 is configured to send the first frame data, the first target desktop data, and the first area information to a receiving device, so that the receiving device fuses the first frame data and the first target desktop data according to the first area information for display.

The screen transmission device provided by the embodiment of the application can be used for executing the screen transmission method provided by the embodiment, and has corresponding functions and beneficial effects.

Fig. 14 is a schematic structural diagram of another screen transmission device according to an embodiment of the present application. Referring to fig. 14, the screen transmitting device provided in this embodiment is applied to a receiving device, and specifically includes: a data receiving unit 21 and a display unit 22.

Wherein, the data receiving unit 21 is configured to receive the first frame data, the first target desktop data, and the first area information sent by the sending device, where the resolution of the first target desktop data is lower than the resolution of the first frame data;

And a display unit 22, configured to fuse the first picture data and the first target desktop data according to the first area information for display.

It should be noted that, in the embodiment of the screen transmission device, each unit and module included are only divided according to the functional logic, but are not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.

Fig. 15 is a schematic structural diagram of a screen capturing device according to an embodiment of the present application, and referring to fig. 15, the screen capturing device includes: processor 31, memory 32, communication module 33, display 34, input device 35 and output device 36. The number of processors in the pass device may be one or more and the number of memories in the pass device may be one or more. The processor, memory, communication module, input device and output device of the screen transmission device may be connected by a bus or other means.

The memory 32 is used as a computer readable storage medium for storing a software program, a computer executable program, and modules, and program instructions/modules corresponding to the screen transmission method according to any embodiment of the present application (for example, an instruction receiving unit, a window screen acquiring unit, a desktop screen acquiring unit, and a screen transmission unit in a screen transmission device). The memory 32 may mainly include a storage program area that may store an operating system, at least one application program required for functions, and a storage data area; the storage data area may store data created according to the use of the device, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, the memory may further include memory remotely located with respect to the processor, the remote memory being connectable to the pass-through device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The processor 31 executes various functional applications of the device and data processing, i.e., implements the screen transfer method described above, by running software programs, instructions and modules stored in the memory.

The communication module 33 is used for data transmission. The display 34 may be displayed, such as displaying a first application window, upon indication by the processor 31. The input means 35 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the device, and may also include audio input means. Output device 36 may include an audio output device.

The screen transmission device provided by the embodiment can be used for executing the screen transmission method provided by the embodiment, and has corresponding functions and beneficial effects.

An embodiment of the present application also provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the relevant operations in the screen-passing method provided in any embodiment of the present application, and have corresponding functions and advantages.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product.

Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash memory (f 1 ash RAM). Memory is an example of a computer-readable medium.

Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (trans itory med i a), such as modulated data signals and carrier waves.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.

Note that the above is only a preferred embodiment of the present application and the technical principle applied. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, while the application has been described in connection with the above embodiments, the application is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the application, which is set forth in the following claims.

Claims

1. A screen transmission method applied to a transmitting device, comprising:

2. The method of claim 1, wherein the performing a hollowed-out process on the desktop image according to the first area information to obtain first target desktop data includes:

responding to the screen transfer control instruction, acquiring a desktop image to obtain a first desktop image, wherein the resolution of the first desktop image is preset first resolution;

performing image quality processing on the first desktop picture according to a preset second resolution to obtain a target desktop picture, wherein the preset second resolution is lower than the preset first resolution;

and carrying out hollowed-out processing on the target desktop picture according to the first area information to obtain the first target desktop data.

3. The method of claim 1, wherein the performing a hollowed-out process on the desktop image according to the first area information to obtain first target desktop data includes:

Determining a first area of the first application window according to the first area information;

when the first area exceeds a preset first threshold value, performing image quality processing on the desktop picture according to a preset third resolution to obtain a second desktop picture;

And carrying out hollowed-out processing on the second desktop picture according to the first area information to obtain the first target desktop data.

4. The method of claim 2, wherein the performing the hollowed-out processing on the target frame according to the first area information to obtain the first target desktop data includes:

When the first area exceeds a preset first threshold value, performing image quality processing on the target desktop picture according to a preset third resolution to obtain a second desktop picture;

5. The method according to claim 1, wherein the sending the first frame data, the first target desktop data, and the first area information to the receiving device for the receiving device to fuse the first frame data and the first desktop data for display according to the first area information includes:

Receiving a window change instruction, and responding to the window change instruction, and changing the region position of the first application window;

acquiring second picture data and second region information of a first application window after the region position is changed, wherein the resolutions of the first picture data and the second picture data are preset first resolutions;

determining a second area of the first application window according to the second area information;

When the second area exceeds a preset first threshold value, performing image quality processing on the desktop picture according to a preset third resolution to obtain a second desktop picture, wherein the resolution of the desktop picture is a preset first resolution, and the preset third resolution is lower than the preset first resolution;

Performing hollowed-out processing on the second desktop picture according to the second region information to obtain second target desktop data;

and sending the second picture data, the second target desktop data and the second area information to receiving equipment so that the receiving equipment fuses the second picture data and the second target desktop data according to the second area information to display.

6. The method according to claim 1, wherein the sending the first frame data, the first target desktop data, and the first area information to the receiving device for the receiving device to fuse the first frame data and the first desktop data for display according to the first area information includes:

acquiring second picture data and second region information of the first application window after the region position is changed;

Determining a second area of the first application window picture according to the second area information;

And stopping acquiring a desktop picture when the second area reaches a preset second threshold value, and sending the second picture data and the second area information to receiving equipment so that the receiving equipment can display the second picture data according to the second area information.

7. The method according to claim 1, wherein the receiving, in the on-screen state, an on-screen control instruction, where before the on-screen control instruction is used to confirm at least one application window currently displayed in the desktop as the first application window, includes:

Receiving a screen transmission code;

analyzing according to the screen transmission code to obtain the IP address of the corresponding receiving equipment;

And establishing communication connection with the receiving equipment according to the IP address.

8. The method of claim 7, wherein after establishing a communication connection with the receiving device according to the IP address, comprising:

Receiving a screen transmission instruction, and responding to the screen transmission instruction, and intercepting a desktop image frame by frame to obtain a first desktop image, wherein the resolution of the first desktop image is a preset first resolution;

performing image quality processing on the first desktop image according to a preset second resolution to obtain target desktop data, wherein the preset second resolution is lower than the preset first resolution;

and sending the target desktop data to corresponding receiving equipment so as to enable the receiving equipment to display according to the target desktop data.

9. The method of claim 1, wherein the performing a hollowed-out process on the desktop image according to the first area information to obtain first target desktop data includes:

According to the first region information, carrying out hollowed-out processing on the corresponding region in the desktop picture to obtain a hollowed-out region;

and replacing the hollowed-out area with blank pixels to obtain the first target desktop data.

10. The method according to claim 1, wherein the receiving a screen-passing control instruction in the screen-passing state, the screen-passing control instruction being used for confirming at least one application window currently displayed in the desktop as the first application window, includes:

Triggering and displaying an application list in a screen transmission state, wherein the application list displays an application window identifier currently displayed in the desktop picture;

And receiving a selection operation of at least one identifier in the application list, and taking the application window determined by the selection operation as a first application window.

11. The method according to claim 10, wherein receiving a selection operation of at least one of the identifiers in the application list, and taking the application window determined by the selection operation as the first application window, includes:

receiving a selection operation and a selection order of at least one identifier in the application list, and taking an application window determined by the selection operation as a first application window;

The responding to the screen transfer control instruction, acquiring first picture data and first area information of the first application window from the desktop picture, comprises the following steps:

responding to the screen transfer control instruction, and sequentially acquiring first picture data and first area information of the first application window from the desktop picture according to the selection order;

The sending the first frame data, the first target desktop data and the first area information to a receiving device, so that the receiving device fuses the first frame data and the first target desktop data to display according to the first area information, includes:

And sequentially sending the corresponding first picture data to receiving equipment according to the selection order, and sending the first target desktop data and the first area information to the receiving equipment so that the receiving equipment fuses the first picture data and the first target desktop data according to the first area information and the order of receiving the first picture data for displaying.

12. A screen transmission method applied to a receiving device, comprising:

13. The method of claim 12, wherein the fusing the first picture data and the first target desktop data for display according to the first region information comprises:

determining a first window coordinate according to the first region information, wherein the first window coordinate is a pixel coordinate of the first picture data on a desktop picture corresponding to the first target desktop data;

Determining a second window coordinate according to the first window coordinate and the ratio of the first target desktop data to the resolution of the display screen of the receiving device, wherein the second window coordinate is the pixel coordinate of the first picture data on the display screen of the receiving device;

and fusing the first picture data with the first target desktop data according to the second window coordinates for displaying.

14. The method of claim 13, wherein the determining the second window coordinates based on the first window coordinates and a ratio of the first target desktop data to a resolution of the receiving device display screen comprises:

determining a change coefficient according to the ratio of the resolution of the first target desktop data to the resolution of the display screen of the receiving device;

And obtaining the second window coordinate according to the product of the first window coordinate and the change coefficient.

15. The method of claim 13, wherein the fusing the first frame data to the first target desktop data for display according to the second window coordinates comprises:

according to the ratio of the resolution of the first target desktop data to the resolution of the display screen of the receiving device, performing pixel conversion on the first target desktop data to obtain third target desktop data;

According to the ratio of the resolution of the first picture data to the resolution of the display screen of the receiving device, performing pixel conversion on the first picture data to obtain third picture data;

Displaying the third target desktop data to obtain a third desktop picture;

And fusing the third picture data to the coordinate position corresponding to the third desktop picture according to the second window coordinate for display.

16. The method of claim 15, wherein the fusing the third frame data to the coordinate position corresponding to the third desktop frame for display according to the second window coordinates comprises

Fusing third picture data to a coordinate position corresponding to the third desktop picture according to the second window coordinate;

and displaying the corresponding third picture data in sequence according to the sequence of receiving the first picture data.

17. A screen transmission device applied to a transmitting device, comprising:

18. A screen transmission device applied to a receiving device, comprising:

19. A screen transmission device, comprising:

A memory and one or more processors;

The memory is used for storing one or more programs;

When executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-16.

20. A storage medium storing computer executable instructions which, when executed by a processor, are adapted to carry out the method of any one of claims 1 to 16.