WO2021120008A1

WO2021120008A1 - Data transmission method and device

Info

Publication number: WO2021120008A1
Application number: PCT/CN2019/126039
Authority: WO
Inventors: 张亚凡; 李卫华; 郭湛; 高林
Original assignee: 华为技术有限公司
Priority date: 2019-12-17
Filing date: 2019-12-17
Publication date: 2021-06-24
Also published as: CN114731422A

Abstract

Provided in embodiments of the present application are a data transmission method and device, the method comprising: dividing a first image into multiple image blocks; according to the throughput of a first channel, determining at least one first image block and at least one second image block among the multiple image blocks, the total data amount of the first image blocks being less than or equal to the minimum throughput of the first channel; and transmitting the first image block(s) and the second image block(s) by means of the first channel, the transmission priority of any one of the first image blocks being greater than the transmission priority of any one of the second image blocks. By dividing a first image block and a second image block and by configuring the total data amount of the first image block as less than or equal to the minimum throughput of a first channel and the transmission priority of the first image block as greater than the transmission priority of the second image block, the successful transmission of the first image block may be effectively ensured under the condition of the current throughput of the first channel, avoiding the problem in which data transmission lacks stability.

Description

Data transmission method and device

Technical field

This application relates to the field of communications, and in particular to a data transmission method and device.

Background technique

With the continuous development of communication technology, in the process of data transmission through the data transmission channel, the requirements for the stability of the data transmission are getting higher and higher.

At present, when the existing technology transmits data through a data transmission channel, it usually compresses the data and transmits the compressed data through the data transmission channel. When the throughput of the data transmission channel is jittered, it may cause Critical data loss. In the event of data loss, the critical data needs to be retransmitted.

However, data retransmission will cause a large delay in data transmission, which makes the data transmission lack of stability.

Summary of the invention

The embodiments of the present application provide a data transmission method and device to overcome the problem of lack of stability in data transmission.

In the first aspect, an embodiment of the present application provides a data transmission method, including:

The first image is divided into multiple image blocks; in order to ensure the stability of data transmission, this application divides the multiple image blocks, wherein, according to the throughput of the first channel, at least among the multiple image blocks is determined One first image block and at least one second image block, wherein the total data amount of the first image block is less than or equal to the minimum throughput of the first channel; and the first image block is transmitted through the first channel An image block and the second image block, wherein the transmission priority of any one of the first image blocks is greater than the transmission priority of any one of the second image blocks.

By dividing the first image block and the second image block according to the throughput of the first channel, by setting the total data volume of the first image block to be less than or equal to the minimum throughput of the first channel, and the The transmission priority is greater than the transmission priority of any second image block, so that under the current throughput of the first channel, the successful transmission of the first image block can be effectively guaranteed, and the retransmission of key data can be avoided. The resulting data transmission lacks stability.

In a possible implementation, the first image block and the second image block can be stored in different queues for data transmission, that is to say:

The implementation manner of transmitting the first image block and the second image block through the first channel may be:

Storing the first image block in the first queue;

Storing the second image block in a second queue;

The image blocks in the first queue are transmitted through the first channel, and the image blocks in the second queue are transmitted after the transmission of the image blocks in the first queue is completed, and the transmission of the first queue is prioritized The level is greater than the transmission priority of the second queue.

By storing the first image block and the second image block in different queues, the order of image block transmission can be ensured. At the same time, by setting the priority of the first queue to be greater than the priority of the second queue, One image block is preferentially transmitted, so as to ensure the successful transmission of the first image block.

In another possible implementation manner, the first image block and the second image block can be stored in the same queue for data transmission, that is to say:

Storing the first image block and the second image block in a third queue, in which any one of the first image blocks is located before any one of the second image blocks;

Through the first channel, the image blocks in the third queue are sequentially transmitted.

And, before storing the first image block in the third queue, it can also first determine whether the remaining storage space of the third queue is less than the total data volume of the first image block, if the remaining storage space of the third queue If the storage space is less than the total data amount of the first image block, at least one second image block at the end of the third queue is deleted, wherein the total data amount of the deleted at least one second image block is greater than or It is equal to the total data amount of the first image block.

Therefore, when the first image block and the second image block are stored in the same queue, for the same first image, it is ensured that the first image block is stored before the second image block, and when the next first image generates the first image block , The second image block in the queue can be deleted to ensure that the first image block is preferentially stored in the third queue, thereby effectively ensuring the preferential transmission of the third image block.

In a possible implementation manner, the maximum transmission duration of the first image block is greater than the maximum transmission duration of the second image block.

For the first image block and the second image block, the maximum transmission time is also set respectively, which can effectively avoid the first image block and the second image block occupying the queue for a long time, resulting in low data transmission efficiency or queue congestion. The maximum transmission duration of the first image block is set to be larger, so that the transmission success rate of the first image block can be effectively guaranteed.

In a possible implementation manner, the transmitting the first image block and the second image block through the first channel may be:

Acquire at least one first modulation and coding strategy MCS order corresponding to the first image block, and obtain at least one second MCS order corresponding to the second image block, wherein any of the first MCS orders Is smaller than any of the second MCS orders;

The first image block and the second image block are transmitted through the first channel, wherein the MCS order when the first image block is transmitted on the first channel is the first MCS order, and the The MCS order when the second image block is transmitted on one channel is the second MCS order.

By setting the order of the first MCS corresponding to the first image block to be smaller than the order of the second MCS corresponding to the transmission of the second image block, the successful transmission of the first image block can be effectively ensured.

In a possible implementation manner, the determining at least one first image block and at least one second image block from the multiple image blocks according to the throughput of the first channel includes:

Determine a first value R according to the maximum throughput of the first channel and the minimum throughput of the first channel, where the R is an integer greater than or equal to 1;

According to the R, a third image block is determined in every R image blocks of the plurality of image blocks, and an image block other than the third image block is determined as a fourth image block;

If the total data volume of the third image block is equal to the minimum throughput of the first channel, the third image block is determined as the first image block, and the fourth image block is determined as the first image block. Two image blocks.

By determining R according to the minimum throughput and maximum throughput of the first channel, and determining the third image block and the fourth image block according to R, it can be ensured that the currently determined third image block and fourth image block conform to the first According to the transmission quality of the channel, and the total amount of data in the third image block is equal to the minimum throughput of the first channel, directly determining the third image block as the first image block can effectively enhance the convenience of determining the second image block.

In another possible implementation manner, if the total data amount of the third image block is less than the value corresponding to the minimum throughput of the first channel, the method further includes:

Select a sub-image block in the fourth image block, and determine the third image block and the selected sub-image block as the first image block, wherein the selected sub-image block and the third image The total data amount of the block is equal to the minimum throughput of the first channel;

Determine an image block other than the sub image block in the fourth image block as a second image block.

By reallocating the image blocks into the first image block and the second image block according to the division of the third image block and the fourth image block and the throughput of the first channel, the minimum throughput of the first channel can be Above, transmit as many image blocks as possible to improve the display effect of the first image on the receiving device, and this process can ensure the successful transmission of the selected third image block, thereby effectively ensuring the stability of data transmission .

In a possible implementation manner, the determining, according to the R, a third image block in each R image blocks of the multiple image blocks includes:

According to the R, the Kth image block in every R image blocks is determined as the third image block.

By determining the Kth image block in every R image blocks as the third image block, the equal interval of the selected third image block in the first image can be effectively guaranteed, so as to ensure the display effect of the first image .

Determine the first mean value of the pixel values of each R image block;

The target image block in each of the R image blocks is determined as a third image block, where the target image block is an image block with the smallest difference between the average pixel value and the first average value.

In another possible implementation manner, the ratio of the minimum throughput of the first channel to the maximum throughput of the first channel is equal to the ratio of the value 1 to the R.

In a possible implementation manner, before determining a third image block in each R image blocks of the plurality of image blocks according to the R, the method further includes:

Performing discrete cosine transform processing, and/or quantization processing, and/or sorting processing on the plurality of image blocks to obtain processed image blocks;

Perform joint compression on every R processed image blocks to obtain multiple image blocks after joint compression.

By performing joint compression on every first number of processed image blocks, multiple image blocks after joint compression are obtained. By performing encoding processing and joint compression processing on image blocks, the amount of transmitted data can be effectively reduced to improve data transmission efficiency.

In a second aspect, an embodiment of the present application provides a data transmission device, including:

A dividing module for dividing the first image into multiple image blocks;

The determining module is configured to determine at least one first image block and at least one second image block in the plurality of image blocks according to the throughput of the first channel, wherein the total data amount of the first image block is less than or Equal to the minimum throughput of the first channel;

The transmission module is configured to transmit the first image block and the second image block through the first channel, wherein the transmission priority of any one of the first image blocks is greater than that of any one of the second image blocks Transmission priority.

In a possible implementation manner, the transmission module is specifically configured to:

Storing the first image block in the first queue;

Storing the second image block in a second queue;

In a possible implementation manner, the transmission module is also used to:

Before storing the first image block in the third queue, if the remaining storage space of the third queue is less than the total data volume of the first image block, delete at least the end of the third queue A second image block, wherein the total data amount of the deleted at least one second image block is greater than or equal to the total data amount of the first image block.

Acquire the first modulation and coding strategy MCS order corresponding to the first image block, and obtain the second MCS order corresponding to the second image block, wherein the first MCS order is smaller than the second MCS order. MCS order;

In a possible implementation manner, the determining module is specifically configured to:

In a possible implementation manner, if the total data amount of the third image block is less than the value corresponding to the minimum throughput of the first channel, the determining module is further configured to:

Determine the first mean value of the pixel values of each R image block;

In a possible implementation manner, the ratio of the minimum throughput of the first channel to the maximum throughput of the first channel is equal to the ratio of the value 1 to the R.

In a possible implementation manner, the determining module is further configured to:

Before the third image block is determined in each R image blocks of the plurality of image blocks according to the R, discrete cosine transform processing and/or quantization processing are performed on the plurality of image blocks, and / Or sort processing to obtain processed image blocks;

In a third aspect, an embodiment of the present application provides a data transmission device, including a memory, a processor, and a radio frequency transceiver. The memory is used to store a program or instruction. When the program or instruction is executed by the processor, The device is caused to execute the method described in the first aspect and any of the various possible designs of the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, including instructions, which when run on a computer, cause the computer to execute the above-mentioned first aspect and any of the various possible designs of the first aspect method.

In a fifth aspect, embodiments of the present application provide a computer program product. The computer program product includes instructions that, when executed, cause a computer to execute the data transmission method described in any one of the above-mentioned first aspects.

In a sixth aspect, the embodiments of the present application provide a system on a chip or a system chip, the system on a chip or a system chip can be applied to a terminal device, and the system on a chip or a system chip includes: at least one communication interface, at least one processing The communication interface, the memory, and the processor are interconnected by a bus, and the processor executes the instructions stored in the memory so that the terminal device can perform data transmission as described in any one of the first aspect method.

In the data transmission method and device provided in this embodiment, the first image block and the second image block are divided according to the throughput of the first channel, and the total data amount of the first image block is set to be less than or equal to the first image block. The minimum throughput of the channel, and the transmission priority of any first image block is greater than the transmission priority of any second image block, so that under the current throughput of the first channel, it can effectively guarantee the transmission of the first image The successful transmission of the block avoids the lack of stability of data transmission caused by the retransmission of key data.

Description of the drawings

FIG. 1 is a schematic diagram of a data transmission system provided by an embodiment of the present invention;

FIG. 2 is a schematic flowchart of a data transmission method in the prior art;

Figure 3 is the first flow chart of the data transmission method provided by this application;

FIG. 4 is a second flowchart of a data transmission method provided by an embodiment of this application;

FIG. 5 is a schematic diagram of image block division according to an embodiment of the application;

FIG. 6 is a first schematic diagram of a third image block provided by an embodiment of this application;

FIG. 7 is a second schematic diagram of determining a third image block according to an embodiment of the application;

FIG. 8 is a third schematic diagram of determining a third image block according to an embodiment of the application;

FIG. 9 is a schematic diagram of a first image formed by partial image blocks provided by an embodiment of the application;

FIG. 10 is a schematic diagram 1 of image block reallocation provided by an embodiment of this application;

FIG. 11 is a second schematic diagram of image block reallocation according to an embodiment of this application;

FIG. 12 is a third flowchart of a data transmission method provided by an embodiment of this application;

FIG. 13 is a schematic diagram of a first queue and a second queue provided by an application embodiment;

FIG. 14 is a fourth flowchart of a data transmission method provided by an embodiment of this application;

FIG. 15 is a schematic diagram of a third queue provided by an application embodiment;

FIG. 16 is a fifth flowchart of a data transmission method provided by an embodiment of this application;

FIG. 17 is a first structural diagram of a data transmission device provided by an embodiment of this application;

FIG. 18 is a second structural diagram of a data transmission device provided by an embodiment of this application;

FIG. 19 is a schematic diagram of the hardware structure of a data transmission device provided by an embodiment of the application.

Detailed ways

First, the data transmission process will be described with reference to FIG. 1. FIG. 1 is a schematic diagram of a data transmission system provided by an embodiment of the present invention. As shown in FIG. 1, the system includes:

The sending device 101 and the receiving device 102, wherein the sending device 101 and the receiving device 102 transmit data through a first channel. Specifically, the first channel transmits the data sent by the sending device 101 to the receiving device in the form of radio waves. The device 102 is used to implement data transmission between the sending device 101 and the receiving device 102. It can be understood that the first channel may be a wireless channel, where the wireless channel is an intangible communication between the sending device and the receiving device during wireless communication. Transmission path, as far as radio waves are concerned, it is transmitted from the sending end to the receiving end without a tangible physical connection between them, and there may be more than one propagation path.

In this embodiment, the sending device 101 and the receiving device 102 may be, for example, terminal devices, or may also be network devices, so the following briefly describes the terminal devices and network devices:

Terminal equipment: It is a kind of equipment with wireless transceiver function. Terminal devices can be deployed on land, including indoor or outdoor, handheld, wearable, or vehicle-mounted; they can also be deployed on water (such as ships, etc.); they can also be deployed in the air (such as airplanes, balloons, and satellites). The terminal device may be a mobile phone (mobile phone), a tablet computer (Pad), a computer with wireless transceiver function, virtual reality (VR) terminal equipment, augmented reality (AR) terminal equipment, industrial Wireless terminals in control (industrial control), vehicle-mounted terminal equipment, wireless terminals in self-driving (self-driving), wireless terminal equipment in remote medical (remote medical), wireless terminal equipment in smart grid (smart grid), Wireless terminal equipment in transportation safety, wireless terminal equipment in smart city, wireless terminal equipment in smart home, wearable terminal equipment, etc. The terminal equipment involved in the embodiments of the present application may also be referred to as a terminal, user equipment (UE), access terminal equipment, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station , Remote terminal equipment, mobile equipment, UE terminal equipment, wireless communication equipment, UE agent or UE device, etc. The terminal device can also be fixed or mobile.

Network equipment: It is a kind of equipment with wireless transceiver function. Including but not limited to: Evolutional Node B (eNB or eNodeB) in long term evolution (LTE), base station (gNodeB or gNB) or transceiver point (gNodeB or gNB) in new radio technology (NR) transmission receiving point/transmission reception poin, TRP), the base station in the subsequent evolution system, the access node in the wireless fidelity (wireless fidelity, WiFi) system, the wireless relay node, the wireless backhaul node, etc. The base station can be: a macro base station, a micro base station, a pico base station, a small station, a relay station, or a balloon station, etc. Multiple base stations can support networks of the same technology mentioned above, or networks of different technologies mentioned above. The base station can contain one or more co-site or non-co-site TRPs. The network device may also be a wireless controller, a centralized unit (CU), and/or a distributed unit (DU) in a cloud radio access network (cloud radio access network, CRAN) scenario. The network device can also be a server, a wearable device, or a vehicle-mounted device. The following description takes the network device as a base station as an example. The multiple network devices may be base stations of the same type, or base stations of different types. The base station can communicate with the terminal, and it can also communicate with the terminal through a relay station. The terminal can communicate with multiple base stations of different technologies. For example, the terminal can communicate with a base station that supports an LTE network, or can communicate with a base station that supports a 5G network, and can also support dual connections with a base station of an LTE network and a base station of a 5G network. , It can also support dual connections with 5G network base stations, etc.

In the specific implementation process, the specific implementation of the sending device 101 and the receiving device 102 can be selected according to actual needs, as long as the sending device 101 has the wireless sending function and the receiving device 101 has the wireless receiving function. The selection of the receiving device 102 is not limited.

Based on the system introduced in Fig. 1, the following describes the implementation of data transmission in the prior art in conjunction with Fig. 2. Fig. 2 is a schematic flow chart of the data transmission method in the prior art, as shown in Fig. 2:

First, the sending device converts the image data to be transmitted from the RGB color mode to the YCrCb color mode. Among them, the RGB color mode is a color standard in the industry. At present, all colors displayed on the display screen of the terminal device are controlled by this The three colors of red (R), green (G), blue (B) are mixed in different proportions, and the YCrCb color mode is used to optimize the transmission of color video signals to make it backward compatible with old-fashioned black-and-white displays. Therefore, converting the image data from the RGB color mode to the YCrCb color mode can ensure the compatible display of the image data on the black and white display screen.

Secondly, discrete cosine transform (DCT) processing is performed on the image data after the color mode conversion, and the processed image data is subjected to image compression based on H.264/H.265 to obtain compressed image data.

Then, the compressed image data is transmitted through the first channel. Specifically, a transmitteer based on Orthogonal Frequency Division Multiplexing (OFDM) is used for data transmission.

However, the throughput of the first channel may change during data transmission. Specifically, the throughput of the channel refers to the number of data bits that are correctly transmitted per unit time. In the implementation of the prior art, image compression and Transmission is a completely separate step, which does not take into account the change in channel throughput. When the channel throughput becomes smaller, it may cause data loss. When the image data received by the receiving device is lost, it may cause blurring, blurring, etc. Phenomenon, it will cause the user's visual experience to be poor.

When key data is lost, it is necessary to retransmit the key data to ensure the correct display of the image data. Among them, the retransmission of the key data will cause a large delay in receiving the image data by the receiving device, and the image data cannot be guaranteed to be displayed in real time. , Which leads to a lack of stability in data transmission, and also leads to a poor sense of balance for users.

In view of the problems in the prior art, this application provides a data transmission method to ensure the stability of data transmission. The method will be introduced below with reference to FIG. 3, which is a first flow chart of the data transmission method provided by this application. .

As shown in Figure 3, the method includes:

S301. Divide the first image into multiple image blocks.

In this embodiment, the data sent by the sending device to the receiving device is specifically image data. In a possible implementation, the sending device may divide the video data to be transmitted into frames to obtain multiple first images. A plurality of first images are transmitted sequentially to realize the transmission of video data; or, the sending device may also directly send image data, where the image data includes at least one first image, which is not limited in this embodiment.

Specifically, for any first image, the first image is divided into multiple image blocks. In a possible implementation manner, for example, the first image may be divided into X×Y image blocks of equal size. , Where X and Y are integers greater than 1; or, the first image can also be divided into multiple image blocks according to a fixed pixel size. This embodiment does not limit the specific implementation of the divided image blocks, and in actual operation In the process, the image blocks can be divided according to actual needs, as long as the first image can be divided into multiple image blocks of the same size.

S302. Determine at least one first image block and at least one second image block among multiple image blocks according to the throughput of the first channel, where the total data amount of the first image block is less than or equal to the minimum throughput of the first channel the amount.

In this embodiment, to ensure that the receiving device can stably receive image data, the sending device divides multiple image blocks into a first image block and a second image block, where the first image block can be understood as a key image block ( key block), which is specifically an image block that needs to be successfully transmitted, and the second image block can be understood as a Not Key block, which is specifically an image block to be transmitted as best as possible, that is, the first image is guaranteed first For block transmission, when the throughput of the first channel is insufficient to realize the transmission of the second image block, the second image block may not be transmitted currently.

Based on the above introduction, it can be understood that in a possible implementation manner, at least one first image block and at least one second image block in this embodiment jointly constitute all the image blocks obtained by division, that is to say, in this embodiment In the example, multiple image blocks can be divided into a first image block and a second image block.

In this embodiment, the first image block and the second image block are divided according to the throughput of the first channel. Specifically, the sending device can obtain the throughput of the first channel at the current moment. The transmission quality of the channel is changing all the time, so the throughput of the first channel at the current moment is usually within a range, and the minimum throughput of the first channel can be further determined. For example, the throughput of the first channel can be 25.5Mb/s( Megabits per second)-10Mb/s, then the minimum throughput of the first channel is 10Mb/s.

In order to ensure that the first channel can successfully transmit the first image block, this embodiment determines at least one first image block among multiple image blocks, where each image block corresponds to the same size, for example, a first image block. The image block may be 4 bits, and the size of each image block in this embodiment depends on the division method of the image block in step S301, which is not limited in this embodiment.

Wherein, the determined total data volume of the first image block is less than or equal to the minimum throughput of the first channel. At the same time, in this embodiment, it is also determined that there is at least one second image block. In a possible implementation manner, After the first image block is determined, the image blocks other than the first image block are determined as the second image block, because the size of each image block in this embodiment is the same, and the amount of data is the same, so The number of second image blocks can be obtained according to the total data volume of image blocks other than the first image block and the individual data volume of each image block; or, the second image block can also be determined directly based on the above-mentioned divided image blocks. The number of image blocks is not particularly limited in this embodiment.

In a possible implementation manner, for example, sampling selection at equal intervals may be performed among multiple image blocks, at least one image block obtained by sampling is determined as the first image block, and at least one image block that is not sampled is determined as the first image block. Two image blocks; alternatively, a preset number of image blocks can be used as a sampling unit, and the image blocks can be selected in each sampling unit to obtain at least one first image block, etc., it can be understood that the first image block The sum of the number sum and the number of the second image block is the total number of divided image blocks.

This embodiment does not limit the specific division of the first image block and the second image block. It can be understood that as long as the total data volume of the first image block is less than or equal to the minimum throughput of the first channel, and the first The sum of the number of image blocks and the number of second image blocks only needs to be the total number of image blocks, and the specific implementation manner can be set according to actual requirements.

S303. The first image block and the second image block are transmitted through the first channel, wherein the transmission priority of any first image block is greater than the transmission priority of any second image block.

In this embodiment, by setting the transmission priority of any first image block to be greater than the transmission priority of any second image block, it is possible to give priority to the first image block when the first image block and the second image block coexist. Image block transmission, and because the total data volume of the first image block is less than or equal to the minimum throughput of the first channel, the successful transmission of the first image block can be guaranteed.

Among them, the total data volume of the first image block in this embodiment is less than or equal to the minimum throughput of the first channel. Therefore, it can be guaranteed that under the current throughput of the first channel, the first image block must be For successful transmission, as long as the receiving device can successfully receive the first image block, the problem of key image data loss caused by fluctuations in the channel throughput can be avoided, thereby ensuring the stability of the data transmission of the first image block.

In addition, in this embodiment, after the transmission of the first image block is completed, the second image block is transmitted as best, that is to say, under the actual throughput of the current first channel, the second image block can be transmitted as much as possible. How much is transmitted, it can be understood that the more second image blocks are transmitted, the clearer the first image displayed by the receiving device.

In an alternative embodiment, if the current second image block cannot be transmitted, the second image block can be discarded, or when the preset period arrives, if the first image block does not exist, try to transfer the second image block. Block retransmission.

In a possible implementation manner, in the process of transmitting the first image block and the second image block through the first channel in this embodiment, the first MCS order corresponding to the first image block can be obtained, and the second image can be obtained. The second MCS order corresponding to the block. In the image block transmission process through the first channel, the MCS order when the first channel transmits the first image block is the first MCS order, and the first channel transmits the second image block The MCS order at that time is the second MCS order.

The MCS order is first introduced here. Among them, the first channel includes many different data streams. Among them, the data stream is used to realize the transmission of image blocks. Different data streams correspond to their respective MCS orders. When the data stream is The lower the MCS order, the better the transmission quality of the data stream. Therefore, in this embodiment, the first MCS order corresponding to the first image block is set to be smaller than the second MCS order corresponding to the second image block to be transmitted. It can effectively guarantee the successful transmission of the first image block.

In a possible implementation manner, a first MCS order table and a second MCS order table may be preset, wherein the first MCS order table and the second MCS order table both include multiple MCS orders At the same time, any MCS order in the first MCS order table is smaller than any MCS order in the second MCS order table. After the first image block and the second image block are determined, the first MCS order The table is determined as the table corresponding to the first image block, and the second MCS order table is determined as the table corresponding to the second image block, so that the first MCS order and the second MCS order can be obtained.

In the process of data transmission through the first channel, the corresponding table can be consulted to determine the MCS order, and the image block can be transmitted according to the MCS order.

In another possible implementation manner, a better channel coding manner may also be assigned to the first image block to ensure the successful transmission of the first image block.

The data transmission method provided by the embodiment of the present application includes: dividing the first image into a plurality of image blocks. According to the throughput of the first channel, at least one first image block and at least one second image block are determined among a plurality of image blocks, wherein the total data amount of the first image block is less than or equal to the minimum throughput of the first channel. The first image block and the second image block are transmitted through the first channel, wherein the transmission priority of any first image block is greater than the transmission priority of any second image block. By dividing the first image block and the second image block according to the throughput of the first channel, by setting the total data volume of the first image block to be less than or equal to the minimum throughput of the first channel, and the The transmission priority is greater than the transmission priority of any second image block, so that under the current throughput of the first channel, the successful transmission of the first image block can be effectively guaranteed, and the retransmission of key data can be avoided. The resulting data transmission lacks stability.

On the basis of the above-mentioned embodiment, the data transmission method provided by the embodiment of the present application will be further described in detail below with reference to Figs. 4-11. Fig. 4 is the second flowchart of the data transmission method provided by the embodiment of the present application, and Fig. 5 is The image block division diagram provided by the embodiment of the present application. FIG. 6 is the first schematic diagram of the third image block provided by the embodiment of the present application. FIG. 7 is the second schematic diagram of determining the third image block provided by the embodiment of the present application. The third schematic diagram of determining the third image block provided by the application embodiment. FIG. 9 is a schematic diagram of the first image formed by part of the image blocks provided by the embodiment of this application. 11 is the second schematic diagram of image block reallocation provided in the embodiment of this application.

As shown in Figure 4, the method includes:

S401. Divide the first image into multiple image blocks.

A possible implementation of dividing image blocks will be described below with reference to FIG. 5. As shown in FIG. 5, there is currently a first image. Assuming that the first image is a 64×64 pixel image, it can be exemplified The first image is divided according to the 8×8 specification to obtain 64 image blocks. Because the first image is 64×64 pixels, each image block may include 8×8 pixels.

Those skilled in the art can understand that FIG. 5 is only an example of a possible way of dividing image blocks. The specific way of dividing image blocks can be selected according to actual needs. For example, the specifications of the division or the way of dividing can be selected according to actual needs. For actual demand expansion, please refer to the introduction in step S301 for details, which will not be repeated here.

S402: Determine a first value R according to the maximum throughput of the first channel and the minimum throughput of the first channel.

In this embodiment, the first value R is used to determine the third image block and the fourth image block in the subsequent steps. Several possible implementations for determining the first value R according to the throughput of the first channel are described below. Introduction:

In a possible implementation, the ratio of the minimum throughput of the first channel to the maximum throughput of the first channel is equal to the ratio of the value 1 to the first value R.

In other words, the value of the first value R satisfies the following formula 1:

1: R=Minimum Throughput: Maximum Throughput Formula One

In another possible implementation, the ratio of the total data volume of the first image block to the total data volume of the first image block and the total data volume of the second image block is less than the ratio of the value 1 to the first value R, In other words, the value of the first value satisfies the following formula 2:

KeyBlock data volume: (KeyBlock data volume + NKeyBlock data volume) <= 1: R Formula 2

In yet another possible implementation manner, the first value is the difference between the ratio of the maximum throughput and the minimum throughput of the first channel, that is, the value of the first value satisfies the following formula 3:

R=U-V Formula 3

Among them, U is the numerator of the ratio of the maximum throughput to the minimum throughput, and V is the denominator of the ratio of the maximum throughput to the minimum throughput, that is, U and V satisfy the following formula 4:

Minimum throughput: Maximum throughput=U:V Formula 4

It is understandable that the first value R in this embodiment is used to subsequently determine the third image block and the fourth image block, and its specific implementation method can be extended according to actual needs based on the above introduction, as long as the first value R is used to determine the third image block and the fourth image block. A value is determined according to the maximum throughput and minimum throughput of the first channel, and can be used to determine the image block. In this embodiment, when the first value is not an integer, the first value can be Rounding, the rounding method can be, for example, rounding, rounding up, rounding down, etc., which is not limited here.

It should be noted that the first value in this embodiment is determined by the sending device according to the throughput of the first channel. Therefore, the first value R in this embodiment will change. Therefore, the various types of R described above are Possible implementations are determined in a certain channel scenario and within a certain time range. As time goes by and the channel scenario changes, the corresponding R will change. At the same time, the sending device also needs to signal The determined first value is sent to the receiving device, so that the same first value is synchronized between the sending device and the receiving device, thereby ensuring that the receiving device successfully receives and parses the first image.

S403: According to the first value, a third image block is determined in every R image blocks of the plurality of image blocks, and image blocks other than the third image block are determined as the fourth image block.

In this embodiment, the first value is used to determine the third image block and the fourth image block. First, the third image block and the fourth image block are described. In this embodiment, the third image block (must block ) Is an image block that must be successfully transmitted, and the fourth image block (Not Must block) includes a best-effort image block, and may also include an image block that must be successfully transmitted.

In a possible implementation, when the data volume of the third image block has met the data volume requirement of the first image block, the image blocks included in the fourth image block are the image blocks that are transmitted as best as possible. However, When the data volume of the third image block has not reached the data volume requirement of the first image block, some image blocks can be selected from the fourth image block as the first image block, and these selected image blocks are the images that must be successfully transmitted. Therefore, the transmission of more image blocks can be realized under the current throughput of the first channel.

The following describes how to determine the third image block and the fourth image block:

For ease of introduction, the following uses R to refer to the first value. Specifically, R image blocks are used as a sampling unit, and one or more third image blocks are determined in each R image block. The possible implementation of determining the third image block is introduced:

In a possible implementation manner, the Kth image block in every R image blocks may be determined as the third image block, where K is an integer greater than or equal to 1.

Taking R is 4 and K is 1 as an example, it will be described in conjunction with Figure 6, that is to say, the first image block in every 4 image blocks is determined as the third image block, which is marked by a bold solid line in Figure 6 A sampling unit (every 4 image blocks) is drawn, and the first image block in every 4 image blocks is marked with a shadow to indicate that the current image block is the third image block, and at the same time, except for the third image block Is the fourth image block, and a blank mark is used in the figure.

It should be noted that Figure 6 is only an exemplary introduction to this implementation. In the actual implementation process, for example, 4 image blocks in a row can be used as a sampling unit, or 4 image blocks in a column can be used as a sampling unit. The image block is used as a sampling unit, etc., where the specific implementation manner of K can also be selected according to actual requirements. This embodiment does not limit the division of the sampling unit and the selection of K.

In another possible implementation manner, the first average value of the pixel values of each R image block may be determined, and the target image block in each R image block may be determined as the third image block, where the value of the target image block The difference between the mean value of the pixel value and the first mean value is the smallest.

Similarly, taking R is 4 as an example, it will be described in conjunction with Figure 7. Each image block includes multiple pixels, and each pixel corresponds to its respective pixel value. Then, every 4 image blocks can be determined according to the pixel value of each pixel. The first average value of the pixel values, see Fig. 7, assuming that the first average value of the pixel value of one sampling unit is 4, and the average value of the pixel values of the 4 image blocks included in the sampling unit are respectively 9, 5, 20 , 6, then the average value of the pixel value with the smallest difference from the first average value is 5, then the target image block corresponding to the average pixel value of 5 is determined as the third image block, marked with a shadow, except for the third image block The determined image block is the fourth image block, which is marked with a blank. The determined third image block and the fourth image block can be as shown in Figure 7. It is understandable that because the method of calculating the difference is adopted in this embodiment, , The arrangement of the third image block is irregular.

In yet another possible implementation, if the first image currently transmitted is a key image or a key frame, that is to say, the complete and successful transmission of the first image must be ensured, then each image included in the first image All the blocks are determined to be the third image block, referring to FIG. 8, each image block in the current first image is marked with shading to indicate that all the image blocks in the current first image are third image blocks.

Correspondingly, another first image or another video frame can be sacrificed, that is, part or all of the other first image or video frame is used as the fourth image block to ensure the successful transmission of the current image frame.

In addition, this embodiment is aimed at image data. In other embodiments, if the current transmission data is voice data or control data, it can be understood that voice data or control data can only be received if successful transmission is guaranteed. When the device receives correct information, it needs to use voice data or control data as data that must be successfully transmitted, which can be used as a third data block (must block), which is equivalent to the third image block in this embodiment.

With reference to the above introduction, those skilled in the art can understand that the third image block in this embodiment is an image block that must be successfully transmitted. However, the selected third image blocks are not because the current image block is in the first image. More importantly, this embodiment only selects a uniformly sampled image block in the first image as the third image block, because for an image, when the first channel cannot guarantee the complete transmission of the first image, Part of the data sampled therein can be transmitted, and the sampled data can still completely represent the information carried in the first image. In this embodiment, in each image in the above example, for ease of description, the number of image blocks is very large. In the actual application process, when the number of image blocks is large, it will not affect the display of the first image. The effect will be described below with reference to FIG. 9:

Referring to Fig. 9, 901 in Fig. 9 is the original first image, and 902 is the first image corresponding to the original first image with some image blocks missing. It can be seen from Fig. 9 that although 902 does not Including all pixels, but we can still receive the information included in the first image.

It should be noted that Fig. 9 is only an exemplary illustration, and the image block loss effect shown by it is relatively serious. In the actual application process, it is very likely that only a small part of the image block cannot be successfully transmitted, so the receiving device The first image received does not have very obvious pixel missing.

Those skilled in the art can understand that the specific image block division method can be selected according to actual needs, and is not limited to the three implementation methods described above, as long as the selected third image block is evenly distributed in the first image Can be.

S404: Determine whether the total data amount of the third image block is equal to the minimum throughput of the first channel, if yes, execute S405, and if not, execute S406.

In this embodiment, the third image block and the fourth image block are selected according to R. Therefore, the number of selected third image blocks may be less than the minimum throughput of the first channel, or may be equal to the maximum throughput of the first channel. In this embodiment, the specific number of the third image block cannot be determined. In order to ensure that under the current throughput of the first channel, as many image blocks as possible can be transmitted, the first image block is set in this embodiment. The total data volume of the image block is equal to the minimum throughput of the first channel.

Specifically, the third image block in this embodiment is an image block that must be successfully transmitted. Therefore, it is first determined whether the total data volume of the third image block is equal to the minimum throughput of the first channel.

It is worth noting that the judgment step of S404 in this embodiment is written to ensure the readability of the embodiment. In the actual implementation process, there may be no current judgment step, but S405 or S406 is directly executed.

S405. Determine the third image block as the first image block, and determine the fourth image block as the second image block.

In a possible implementation, if the total data volume of the third image block is equal to the minimum throughput of the first channel, it indicates that at this time, according to the minimum throughput of the first channel, the success of the third image block can be guaranteed. For transmission, the third image block is directly determined as the first image block, so that the successful transmission of the first image block can be ensured under the current throughput of the first channel.

And, in this embodiment, the fourth image block is determined to be the second image block.

S406. Select a sub-image block in the fourth image block, determine the third image block and the selected sub-image block as the first image block, and determine image blocks other than the sub-image blocks in the fourth image block as the first image block. The second image block. Wherein, the total data amount of the selected sub-image block and the third image block is equal to the minimum throughput of the first channel.

If the total data volume of the third image block is not equal to the throughput of the first channel, in a possible implementation, the total data volume of the third image block is less than the throughput of the first channel, indicating that the current first channel In the case of throughput, in addition to guaranteeing the successful transmission of the third image block, there are extra resources to ensure the successful transmission of part of the fourth image block. Then you can select the sub-image block in the fourth image block and change This part of the sub-image block selected from the fourth image also serves as the first image block. Specifically, the sub-image block may be a complete image block or a part of an image block.

In this embodiment, it is set that the total data volume of the first image block is equal to the minimum throughput of the first channel, and the total data volume of the third image block and the selected sub-image block is equal to the throughput of the first channel. .

In another possible implementation, if the total data volume of the third image block is greater than the minimum throughput of the first channel, it indicates that according to the minimum throughput of the first channel at this time, there is no way to ensure that all third image blocks are The successful transmission of the image block. In this case, we still determine the third image block as the first image block, so as to ensure that the third image block can be transmitted as a priority in the future, so as to ensure the third image block as much as possible In order to effectively improve the transmission success rate of the third image block when the throughput of the first channel is small.

It is understandable that, based on the minimum throughput of the first channel, the third image block is transmitted as best as possible. If the transmission of the third image block times out and the transmission is still not successful, the third image block can only be discarded .

Based on the above introduction, it can be understood that if the total data volume of the third image block is equal to the minimum throughput of the first channel, the third image block can be directly determined as the first image block, and a specific example will be combined below. When the total data amount of the third image block is less than the minimum throughput of the first channel, a possible implementation manner of determining the first image block and the second image block according to the third image block and the fourth image block is described:

In order to facilitate the description in conjunction with the drawings, suppose the current throughput of the first channel is in the range of 2Mb/s-9Mb/s, and the size of one image block is 1Mb, which means that the two first image blocks should be selected currently, and it is assumed that the current There are 1 third image block and 8 fourth image blocks.

According to the above example, it can be determined that the total data volume of the third image block is less than the minimum throughput of the first channel. At this time, it is necessary to select sub-image blocks from the fourth image block to make the total data of the first image block The amount can be equal to the minimum throughput of the first channel.

In a possible implementation manner, referring to FIG. 10, an image block includes 8×8 pixels. After the pixel blocks are obtained by dividing, DCT processing can also be performed on each pixel block, wherein, each pixel block is obtained. Each corresponding frequency coefficient matrix, where an image block includes 8×8 pixels, then the 8×8 frequency coefficient matrix corresponding to the pixel block has 1 direct current (DC) component and 63 alternating current (AC) components , The number shown in Figure 5 is the DC component or the AC component.

Then the first row of pixels in the fourth image block can be used as the selected sub-image block, and for the eight fourth image blocks, the first row of pixels in each of them can be determined as the first image block, so that the The total data volume of the selected sub-image block and the third image block is equal to the minimum throughput of the first channel, then the first image block includes the third image block and part of the fourth image block. An image block.

At the same time, the remaining sub-image blocks that are not selected in the fourth image block are determined to be the second image blocks, and 7 second image blocks can be obtained in this embodiment.

In another possible implementation, referring to FIG. 11, the third image block can be split into upper and lower parts, where the upper part and the sub-image blocks in the four fourth image blocks together form a first image Block, the lower half and the other four sub-image blocks in the fourth image block together constitute another first image block. Compared with Fig. 10, the selected pixels in Fig. 11 are exactly the same. The difference lies in the first image block. The division method of an image block, that is, the first image block can be a complete image block, and it can also be incomplete and discontinuous. In this embodiment, as long as the total data of the first image block is The amount is equal to the minimum throughput of the first channel, and the specific division method can be selected according to actual needs.

On the basis of the above example of the drawings, it should be noted that there are many ways to select sub-image blocks in the fourth image block. For example, for a fourth image block, one column can be selected; or, you can Select one pixel in each row; alternatively, the current complete fourth image block can also be determined as the first image block, which is not limited in this embodiment, that is, this embodiment does not specifically limit the first image block. The selection method of the image block, as long as it is ensured that the third image block is all the first image block, and the total data volume of the first image block is equal to the minimum throughput of the first channel, its various possible implementation methods can be based on actual needs. To expand, I won’t go into details here.

It can be understood that when the sub-image block is selected as the first image block in the fourth image block, the more even the selection of the sub-image blocks is distributed, the better the effect presented by the image data received by the final receiving device.

In an optional embodiment, the ratio of the total data volume of the first image block to the total data volume of the second image block may be set to satisfy the following formula 5:

Total data volume of the first image block: total data volume of the second image block = minimum throughput: (maximum throughput-minimum throughput) Formula 5

For example, in the example corresponding to Figures 10 and 11, the minimum throughput of the first channel is 2 and the maximum throughput of the first channel is 10, then the total data volume of the first image block and the total data volume of the second image block The ratio relationship of can be 2:7, that is to say, on the basis of ensuring the successful transmission of the first image block according to the minimum throughput, the second image block is transmitted as best as possible according to the actual channel state of the first channel.

S407. Transmit the first image block and the second image block through the first channel, wherein the transmission priority of any first image block is greater than the transmission priority of any second image block.

Specifically, the implementation of S407 is similar to that of S303, and will not be repeated here.

The data transmission method provided by the embodiment of the present application includes: dividing the first image into a plurality of image blocks. According to the maximum throughput of the first channel and the minimum throughput of the first channel, the first value R is determined. According to the first value, the third image block is determined in every R image blocks among the plurality of image blocks, and the image blocks other than the third image block are determined as the fourth image block. It is determined whether the total data volume of the third image block is equal to the minimum throughput of the first channel, and if so, the third image block is determined as the first image block, and the fourth image block is determined as the second image block. If not, select the sub-image block in the fourth image block, determine the third image block and the selected sub-image block as the first image block, and set the image blocks other than the sub-image block in the fourth image block Determined as the second image block. Wherein, the total data amount of the selected sub-image block and the third image block is equal to the minimum throughput of the first channel. The first image block and the second image block are transmitted through the first channel, wherein the transmission priority of any first image block is greater than the transmission priority of any second image block. By first determining the third image block that must be transmitted, and then reallocating the image block into the first image block and the second image block according to the division of the third image block and the fourth image block, and the throughput of the first channel, It is possible to transmit as many image blocks as possible on the basis of the minimum throughput of the first channel to improve the display effect of the first image on the receiving device, and this process can ensure the success of the selected third image block Transmission, which can effectively ensure the stability of data transmission.

On the basis of the above-mentioned embodiments, when transmitting image blocks through the first channel in this application, multiple image blocks may be transmitted through two different queues, or multiple image blocks may also be transmitted through the same queue. Transmission, the following two different implementations are introduced separately.

First, the implementation of transmission through two different queues will be described with reference to FIG. 12 and FIG. 13. FIG. 12 is the third flowchart of the data transmission method provided by the embodiment of the application, and FIG. 13 is the first queue provided by the embodiment of the application. And the schematic diagram of the second queue.

As shown in Figure 12, the method includes:

S1201. Store the first image block in the first queue.

S1202: Store the second image block in the second queue.

In this embodiment, the first image block and the second image block are stored in different queues, referring to FIG. 13, the first image block is stored in the first queue, and the second image block is stored in the second queue, where, The first queue and the second queue are both buffer queues in the first channel, and image blocks are transmitted in a queue manner, which can ensure the order of image block transmission and avoid confusion.

S1203. Transmit the image blocks in the first queue through the first channel, and transmit the image blocks in the second queue after the transmission of the image blocks in the first queue is completed, and the transmission priority of the first queue is greater than the transmission priority of the second queue level.

Specifically, because the transmission priority of the first image block needs to be greater than the transmission priority of the second image block, the transmission priority of the first queue is set to be greater than the transmission priority of the second queue in this embodiment, so that the transmission priority of the first queue is greater than that of the second queue. When there are image blocks in a queue, the image blocks in the first queue are preferentially transmitted through the first channel. After the image blocks in the first queue are transmitted, that is, when the first queue is empty, the first channel is used to transfer the image blocks to the first queue. The image blocks in the second queue are transmitted, so it can be understood that the second image block is transmitted in a best-effort manner.

In a possible implementation manner, for example, the first queue may adopt an enhanced distributed channel access (Enhanced Distributed Channel Access, EDCA) queue.

The data transmission method provided by the embodiment of the present application includes: storing the first image block in the first queue. Store the second image block in the second queue. The image blocks in the first queue are transmitted through the first channel, and the image blocks in the second queue are transmitted after the image blocks in the first queue are transmitted. The transmission priority of the first queue is greater than the transmission priority of the second queue. By storing the first image block and the second image block in different queues, the order of image block transmission can be ensured. At the same time, by setting the priority of the first queue to be greater than the priority of the second queue, One image block is preferentially transmitted, so as to ensure the successful transmission of the first image block.

Next, the implementation of transmitting multiple image blocks through the same queue is described with reference to FIGS. 14 and 15. FIG. 14 is the fourth flowchart of the data transmission method provided by the embodiment of the application, and FIG. 15 is provided by the embodiment of the application. Schematic diagram of the third queue.

As shown in Figure 14, the method includes:

S1401. Determine whether the remaining storage space of the third queue is less than the total data amount of the first image block, if yes, execute S1402, and if not, execute S1403.

Specifically, in this embodiment, the first image block and the second image block are stored in the same queue. To ensure priority transmission of the first image block, it is necessary to ensure that for the same first image, it is currently existing In the case of the first image block, the first image block is always at the head of the queue, specifically, that is, the first image block is always in front of the second image block.

At the same time, when the first image generates the first image block, the generated first image block needs to be stored in the third queue, but before storing, we first need to determine whether the third queue can store the first image block. Specifically, it is determined whether the remaining storage space of the third queue is less than the total data amount of the first image block.

S1402. Delete at least one second image block at the end of the third queue, where the total data amount of the deleted at least one second image block is greater than or equal to the total data amount of the first image block.

If the remaining storage space of the third queue is less than the total data volume of the first image block, it indicates that the first image block cannot be stored in the third queue currently. In order to ensure the effective transmission of the first image block, this embodiment will At least one second image block at the end of the three queues is deleted from the third queue, where the specific number of deleted second image blocks depends on the current remaining storage space and the total data volume of the first image block to be sent The difference, in this embodiment, the total data amount of the at least one second image block that is set to be deleted is greater than or equal to the total data amount of the first image block.

In other words, as long as it is deleted, all the M first image blocks can be stored in the third queue.

It is understandable that because of the first-in-first-out characteristic of the queue, the second image block deleted in this embodiment is actually the second image block of the previous first image. See Figure 15, which is represented by different shading effects. Image blocks corresponding to two different first images, by deleting the second image block that was not sent by the previous first image, it can be ensured that no matter which first image it is for, the first image block can be achieved. Priority delivery.

S1403. Store the first image block and the second image block in a third queue, where the first image block is located before the second image block.

If the remaining storage space of the third queue is not less than the total data volume of the first image block, or after at least one second image block at the end of the queue is deleted, the remaining storage space of the current third queue can realize the first image block to be sent. For the storage of one image block, the first image block is first stored in the third queue. After the storage of the first image block is completed, if there is remaining storage space, part or all of the second image block is stored in the third queue in.

Referring to FIG. 15, the first image block stored in the third queue and the original image block in the previous queue are image blocks corresponding to different first images.

The data transmission method provided by the embodiment of the present application includes: determining whether the remaining storage space of the third queue is less than the total data amount of the first image block, and if so, deleting at least one second image block at the end of the third queue, wherein: The total data amount of the deleted at least one second image block is greater than or equal to the total data amount of the first image block. If not, the first image block and the second image block are stored in the third queue. In the third queue, the first image block is located before the second image block. Therefore, when the first image block and the second image block are stored in the same queue, for the same first image, it is ensured that the first image block is stored before the second image block, and when the next first image generates the first image block , The second image block in the queue can be deleted to ensure that the first image block is preferentially stored in the third queue, thereby effectively ensuring the preferential transmission of the third image block.

On the basis of the embodiments described in Figs. 12 and 14, the data transmission method provided by this application also sets a maximum transmission duration for the first image block and the second image block respectively, so as to avoid the first image block and the second image block. Image blocks occupy the queue for a long time, resulting in low data transmission efficiency or queue congestion.

It is understandable that the maximum transmission duration is used to indicate the maximum duration that the current image block transmission can occupy the queue, which can be understood as a timer. When the timer expires, if the current image block has not been transmitted, Then the current image block is deleted from the third queue, or it may try to retransmit after a preset period of time, or the image block may be directly discarded.

In this embodiment, the maximum transmission duration of the first image block is greater than the maximum transmission duration of the second image block. By setting the maximum transmission duration of the first image block to be larger, the transmission success rate of the first image block can be effectively guaranteed.

Of course, this means that the transmission of the first image block may fail. Those skilled in the art can understand that this embodiment only guarantees the successful transmission of the first image block at the level of the throughput rate of the first channel. If the first image block is not successfully transmitted for a long time due to data corruption, data error, etc., such problems are inevitable. At this time, deleting the first image block can effectively improve the transmission efficiency of the remaining image blocks and avoid causing The queue is congested.

On the basis of the foregoing embodiment, in this embodiment, before the third image block and the fourth image block are determined, a series of encoding processing can be performed on the image blocks. The following is an explanation with reference to FIG. 16, which is an embodiment of the application. Flow chart five of the data transmission method provided.

As shown in Figure 16, the method includes:

S1601: Perform discrete cosine transform processing, and/or quantization processing, and/or sort processing on multiple image blocks to obtain processed image blocks.

Among them, the discrete cosine transform (Discrete Cosine Transform, DCT) is a transform related to the Fourier transform, which can be used for image compression, can convert the signal in the pixel domain to the frequency domain, and has good decorrelation. Performance. DCT processing can create good conditions for subsequent quantization processing, Huffman coding processing, etc. in image encoding, and DCT coefficient matrix can be obtained after DCT processing.

At the same time, this embodiment can also perform quantization processing on multiple image blocks. The quantization processing is the process of converting the corresponding brightness continuous change interval on the pixel into a single specific number. Specifically, the quantization process is actually the DCT coefficient An optimization process of the matrix. It uses the human eye's insensitivity to high-frequency parts to achieve substantial simplification of data.

And, this embodiment can also perform sorting processing on images, where the sorting processing is specifically ZigZag sorting, because the importance of the coefficient matrix is arranged according to the ZigZag mode to a certain extent, so the front of the coefficient matrix can be extracted through the ZigZag mode The important element is used as a feature of the first image in the frequency domain, and then used for classification processing, etc., to achieve the effect of dimensionality reduction.

Those skilled in the art can understand that one or more of the encoding processes described above can be executed, which is not limited in this embodiment.

In an optional embodiment, when compressing the first image, in addition to DCT processing, Singular Value Decomposition (SVD) processing can also be used to compress the image. Specifically, the singular value of the matrix Decomposition is a decomposition method of the matrix. Using the singular value decomposition of the matrix, the main information of the matrix can be extracted, so that the information similar to the original matrix can be restored with less data than the original matrix to achieve the compression of the first image. .

It should be noted that when the SVD process is used to compress the image, the sorting process described above may not be executed.

For the specific implementation manners of the various encoding processes introduced above, reference may be made to the implementation manners in the prior art, which will not be repeated here.

By encoding each image block, the amount of data can be effectively reduced, so as to improve the efficiency of data transmission in the subsequent data processing process.

S1602. Perform joint compression on every first number of processed image blocks to obtain multiple image blocks after joint compression.

Specifically, the first number is introduced in the foregoing embodiment. In addition to indicating the sampling unit, the first number R can also be used for joint compression of image blocks in this embodiment.

Specifically, in this embodiment, joint compression is performed on every R processed image blocks. Specifically, the specific processing method of the joint compression may be Huffman coding compression to obtain multiple image blocks after joint compression.

By performing joint compression on multiple image blocks, the compression ratio of the image blocks can be effectively increased, thereby effectively increasing the data transmission rate in the subsequent data transmission process.

The data transmission method provided by the embodiment of the present invention includes: performing discrete cosine transform processing, and/or quantization processing, and/or sorting processing on multiple image blocks to obtain processed image blocks. Perform joint compression on every first number of processed image blocks to obtain multiple image blocks after joint compression. By performing encoding processing and joint compression processing on image blocks, the amount of transmitted data can be effectively reduced to improve data transmission efficiency.

The virtual modules included in the data transmission device provided by the embodiment of the present application will be introduced below with reference to FIG. 17. FIG. 17 is a first structural schematic diagram of the data transmission device provided by the embodiment of the application. As shown in FIG. 17, the device 170 includes a dividing module 1701, a determining module 1702, and a transmission module 1703.

The dividing module 1701 is configured to divide the first image into multiple image blocks;

The determining module 1702 is configured to determine at least one first image block and at least one second image block in the plurality of image blocks according to the throughput of the first channel, wherein the total data amount of the first image block is less than Or equal to the minimum throughput of the first channel;

The transmission module 1703 is configured to transmit the first image block and the second image block through the first channel, wherein the transmission priority of any one of the first image blocks is greater than that of any one of the second image blocks Transmission priority.

In a possible implementation manner, the transmission module 1703 is specifically configured to:

Storing the first image block in the first queue;

Storing the second image block in a second queue;

In a possible implementation manner, the transmission module 1703 is further configured to:

In a possible implementation manner, the determining module 1702 is specifically configured to:

In a possible implementation, if the total data amount of the third image block is less than the value corresponding to the minimum throughput of the first channel, the determining module 1702 is further configured to:

Determine the first mean value of the pixel values of each R image block;

In a possible implementation manner, the determining module 1702 is further configured to:

The following describes the virtual modules included in the data transmission device provided by the embodiment of the present application and the corresponding execution flow thereof with reference to FIG. 18. FIG. 18 is a second schematic diagram of the structure of the data transmission device provided by the embodiment of the present application. As shown in FIG. 18, the division module 1801, the determination module 1802, and the transmission module 1803.

The dividing module 1801 divides the first image into multiple image blocks. In a possible implementation manner, there may be 3 types of processing:

Type 1: Perform sampling processing on multiple image blocks to obtain a third image block and a fourth image block;

Type 2: After performing DCT processing/SVD processing, quantization processing, and sorting processing on multiple image blocks, then perform joint compression on R (first number) image blocks, and select the third image from the jointly compressed image blocks Block and the fourth image block;

Type 3: After sampling multiple image blocks, perform DCT processing, quantization processing, sorting processing, and joint compression processing to obtain the third image block and the fourth image block;

In the actual implementation process, those skilled in the art can select the required implementation manner according to actual requirements to obtain the third image block and the fourth image block.

It should be noted that in the second implementation, the implementation of selecting the third image block and the fourth image block from the jointly compressed image block is similar to the sampling process, and the sampling process described above corresponds to the foregoing embodiment in FIG. 4 The implementation of step S403 of, will not be repeated here. In addition, the above-mentioned DCT processing/SVD processing, quantization processing, and sorting processing can also be selected according to actual needs, and not all need to be executed. For the specific implementation, please refer to the above-mentioned Figure 16 The content introduced in the embodiment.

Next, the determining module 1802 needs to determine the first image block and the second image block among multiple image blocks, and first divide the image block into a third image block and a fourth image block, but because the third image block and the fourth image block The number of image blocks may not meet the requirements. In order to ensure that as many image blocks as possible are transmitted on the basis of the minimum throughput of the first channel, this embodiment is based on the third image block (Must block) and the fourth image block (Not Must block). ) Perform reallocation to obtain the first image block (Key block) and the second image block (Not Key block).

Next, the transmission module 1803 performs data transmission. See FIG. 18. Multiple image blocks are transmitted through the sending queue in the first channel. At the same time, for each first image block and each second image block in the sending queue A timer is set, and the maximum transmission time of the current image block has been indicated. Each image block in the queue is wirelessly transmitted through the standard WIFI sending unit of the sending device.

The next step is to receive data from the receiving device. Specifically, the standard WIFI receiving unit of the receiving device receives data and restores the received image block to obtain the third image block and/or the fourth image block. Specifically, because the sending device reallocates the image blocks, the receiving device needs to restore the reallocated image blocks.

And, the receiving device decompresses the restored image block corresponding to Huffman coding, and puts the multiple image blocks obtained by decompression into the buffer queue, and each image block in the buffer queue may also have its own timing. The timer is used to indicate the maximum resolution time of the image block, and then the inverse DCT processing/inverse SVD processing is performed on each image block in the buffer queue to obtain the original image block, and perform the first picture according to each image block The buffer is displayed to display the first picture on the display screen of the receiving device.

It should be noted that only when the sending device performs the joint compression of the Huffman code, the receiving device will correspondingly decompress the Huffman code. Similarly, only when the sending device has performed the DCT processing/SVD processing, the receiving device will correspond. The anti-DCT processing/anti-SVD processing is performed on the, so these two processings are not necessarily operations that need to be performed, so the dotted box is used for identification.

The data processing device provided in this embodiment adaptively adjusts the division of the first image block and the second image block in the first image according to the change in the throughput of the first channel, thereby effectively ensuring the successful transmission of the key image block When the transmission of the first channel is jittered, the first image received by the receiving device will become blurred, but the user experience is less, thereby balancing the channel delay and channel jitter, and in this embodiment, when the wireless transmission delay occurs, there is no need to The receiving device feeds back the condition of the first channel to the sending device, so that the sending device performs scheduling, but the sending device adjusts adaptively, which can effectively reduce the delay of data transmission. At the same time, in this embodiment, data transmission is carried out through the standard WiFi sending unit, the standard WiFi receiving unit, and the standard WiFi protocol. Therefore, it can be compatible with the existing WiFi transmission protocol, effectively ensuring the applicability of wireless data transmission, and by Joint compression of multiple image blocks can effectively increase the compression ratio of data and increase the amount of data transmission.

FIG. 19 is a schematic diagram of the hardware structure of a data transmission device provided by an embodiment of the application. As shown in FIG. 19, the data transmission device 190 of this embodiment includes: a memory 1901, a processor 1902, and a radio frequency transceiver 1903. The memory 1901 uses For storing programs or instructions.

In a possible implementation manner, the processor 1902 can implement the functions of the dividing module 1701 and the determining module 1702 in Figs. 17-18, and the radio frequency transceiver 1903 can implement the functions of the transmission module 1703 in Figs. 17-18. See the related descriptions in the foregoing method embodiment and device embodiment. as well as

Optionally, the memory 1902 may be independent or integrated with the processor 1901.

When the memory 1902 is independently provided, the data transmission device further includes a bus 1904 for connecting the memory 1902 and the processor 1901.

Optionally, the foregoing processor may be a central processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), application specific integrated circuits (ASICs) )Wait. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like. The steps in the embodiment of the service processing method disclosed in the embodiment of the present application may be directly embodied as being executed and completed by a hardware processor, or executed and completed by a combination of hardware and software modules in the processor.

The embodiments of the present application also provide a computer-readable storage medium that stores computer-executable instructions. When the processor executes the computer-executed instructions, the data transmission method executed by the above data transmission device is implemented. .

The embodiments of the present application provide a computer program product. The computer program product includes instructions that, when executed, cause a computer to execute the above-mentioned data transmission method.

An embodiment of the present application provides a system on a chip or a system chip, the system on a chip or a system chip may be applied to a terminal device, and the system on a chip or a system chip includes: at least one communication interface, at least one processor, and at least one The memory, the communication interface, the memory, and the processor are interconnected by a bus, and the processor executes the instructions stored in the memory so that the terminal device can execute the above-mentioned data transmission method.

All or part of the steps in the foregoing method embodiments may be implemented by a program instructing relevant hardware. The aforementioned program can be stored in a readable memory. When the program is executed, it executes the steps including the above-mentioned method embodiments; and the aforementioned memory (storage medium) includes: read-only memory (English: read-only memory, abbreviation: ROM), RAM, flash memory, hard disk, Solid state hard disk, magnetic tape (English: magnetic tape), floppy disk (English: floppy disk), optical disc (English: optical disc) and any combination thereof.

The embodiments of the present application are described with reference to the flowcharts and/or block diagrams of the methods, equipment (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing equipment can be used to generate It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. In this way, if these modifications and variations of the embodiments of the present application fall within the scope of the claims of the embodiments of the present application and their equivalent technologies, the embodiments of the present application are also intended to include these changes and modifications.

In the embodiments of the present application, the term "including" and its variations may refer to non-limiting inclusion; the term "or" and its variations may refer to "and/or". The terms "first", "second", etc. in the embodiments of the present application are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. In the embodiments of the present application, "multiple" refers to two or more. "And/or" describes the association relationship of the associated objects, indicating that there can be three types of relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects before and after are in an "or" relationship.

Claims

A data transmission method, characterized in that it comprises:

Dividing the first image into multiple image blocks;

According to the throughput of the first channel, at least one first image block and at least one second image block are determined among the plurality of image blocks, wherein the total data amount of the first image block is less than or equal to the first image block. The minimum throughput of the channel;

The first image block and the second image block are transmitted through the first channel, wherein the transmission priority of any one of the first image blocks is greater than the transmission priority of any one of the second image blocks.
The method according to claim 1, wherein the transmitting the first image block and the second image block through the first channel comprises:

Storing the first image block in the first queue;

Storing the second image block in a second queue;

The image blocks in the first queue are transmitted through the first channel, and the image blocks in the second queue are transmitted after the transmission of the image blocks in the first queue is completed, and the transmission of the first queue is prioritized The level is greater than the transmission priority of the second queue.
The method according to claim 1, wherein the transmitting the first image block and the second image block through the first channel comprises:

Storing the first image block and the second image block in a third queue, in which any one of the first image blocks is located before any one of the second image blocks;

Through the first channel, the image blocks in the third queue are sequentially transmitted.
The method according to claim 3, wherein before storing the first image block in the third queue, the method further comprises:

If the remaining storage space of the third queue is less than the total data amount of the first image block, delete at least one second image block at the end of the third queue, wherein at least one second image block is deleted The total data amount of is greater than or equal to the total data amount of the first image block.
The method according to claim 1, wherein the maximum transmission duration of the first image block is greater than the maximum transmission duration of the second image block.
The method according to any one of claims 1-5, wherein the transmitting the first image block and the second image block through the first channel comprises:

Acquire at least one first modulation and coding strategy MCS order corresponding to the first image block, and obtain at least one second MCS order corresponding to the second image block, wherein any of the first MCS orders Is smaller than any of the second MCS orders;

The first image block and the second image block are transmitted through the first channel, wherein the MCS order when the first image block is transmitted on the first channel is the first MCS order, and the The MCS order when the second image block is transmitted on one channel is the second MCS order.
The method according to claim 1, wherein the determining at least one first image block and at least one second image block in the plurality of image blocks according to the throughput of the first channel comprises:

Determine a first value R according to the maximum throughput of the first channel and the minimum throughput of the first channel, where the R is an integer greater than or equal to 1;

According to the R, a third image block is determined in every R image blocks of the plurality of image blocks, and an image block other than the third image block is determined as a fourth image block;

If the total data volume of the third image block is equal to the minimum throughput of the first channel, the third image block is determined as the first image block, and the fourth image block is determined as the first image block. Two image blocks.
8. The method according to claim 7, wherein if the total data amount of the third image block is less than the value corresponding to the minimum throughput of the first channel, the method further comprises:

Select a sub-image block in the fourth image block, and determine the third image block and the selected sub-image block as the first image block, wherein the selected sub-image block and the third image The total data amount of the block is equal to the minimum throughput of the first channel;

Determine an image block other than the sub image block in the fourth image block as a second image block.
The method according to claim 7, wherein the determining a third image block in each R image blocks of the plurality of image blocks according to the R comprises:

According to the R, the Kth image block in every R image blocks is determined as the third image block.
The method according to claim 7, wherein the determining a third image block in each R image blocks of the plurality of image blocks according to the R comprises:

Determine the first mean value of the pixel values of each R image block;

The target image block in each of the R image blocks is determined as a third image block, where the target image block is an image block with the smallest difference between the average pixel value and the first average value.
The method according to claim 7, wherein the ratio of the minimum throughput of the first channel to the maximum throughput of the first channel is equal to the ratio of the value 1 to the R.
The method according to claim 7, characterized in that, before determining a third image block in every R image blocks of the plurality of image blocks according to the R, the method further comprises:

Performing discrete cosine transform processing, and/or quantization processing, and/or sorting processing on the plurality of image blocks to obtain processed image blocks;

Perform joint compression on every R processed image blocks to obtain multiple image blocks after joint compression.
A data transmission device is characterized in that it comprises:

A dividing module for dividing the first image into multiple image blocks;

The determining module is configured to determine at least one first image block and at least one second image block in the plurality of image blocks according to the throughput of the first channel, wherein the total data amount of the first image block is less than or Equal to the minimum throughput of the first channel;

The transmission module is configured to transmit the first image block and the second image block through the first channel, wherein the transmission priority of any one of the first image blocks is greater than that of any one of the second image blocks Transmission priority.
The device according to claim 13, wherein the transmission module is specifically configured to:

Storing the first image block in the first queue;

Storing the second image block in a second queue;

The image blocks in the first queue are transmitted through the first channel, and the image blocks in the second queue are transmitted after the transmission of the image blocks in the first queue is completed, and the transmission of the first queue is prioritized The level is greater than the transmission priority of the second queue.
The device according to claim 13, wherein the transmission module is specifically configured to:

Storing the first image block and the second image block in a third queue, in which any one of the first image blocks is located before any one of the second image blocks;

Through the first channel, the image blocks in the third queue are sequentially transmitted.
The device according to claim 15, wherein the transmission module is further configured to:

Before storing the first image block in the third queue, if the remaining storage space of the third queue is less than the total data volume of the first image block, delete at least the end of the third queue A second image block, wherein the total data amount of the deleted at least one second image block is greater than or equal to the total data amount of the first image block.
The apparatus according to claim 13, wherein the maximum transmission duration of the first image block is greater than the maximum transmission duration of the second image block.
The device according to claim 13, wherein the transmission module is specifically configured to:

Acquire the first modulation and coding strategy MCS order corresponding to the first image block, and obtain the second MCS order corresponding to the second image block, wherein the first MCS order is smaller than the second MCS order. MCS order;

The first image block and the second image block are transmitted through the first channel, wherein the MCS order when the first image block is transmitted on the first channel is the first MCS order, and the The MCS order when the second image block is transmitted on one channel is the second MCS order.
The device according to claim 13, wherein the determining module is specifically configured to:

Determine a first value R according to the maximum throughput of the first channel and the minimum throughput of the first channel, where the R is an integer greater than or equal to 1;

According to the R, a third image block is determined in every R image blocks of the plurality of image blocks, and an image block other than the third image block is determined as a fourth image block;

If the total data volume of the third image block is equal to the minimum throughput of the first channel, the third image block is determined as the first image block, and the fourth image block is determined as the first image block. Two image blocks.
The apparatus according to claim 19, wherein if the total data amount of the third image block is less than the value corresponding to the minimum throughput of the first channel, the determining module is further configured to:

Select a sub-image block in the fourth image block, and determine the third image block and the selected sub-image block as the first image block, wherein the selected sub-image block and the third image The total data amount of the block is equal to the minimum throughput of the first channel;

Determine an image block other than the sub image block in the fourth image block as a second image block.
The device according to claim 19, wherein the determining module is specifically configured to:

According to the R, the Kth image block in every R image blocks is determined as the third image block.
The device according to claim 19, wherein the determining module is specifically configured to:

Determine the first mean value of the pixel values of each R image block;

The target image block in each of the R image blocks is determined as a third image block, where the target image block is an image block with the smallest difference between the average pixel value and the first average value.
The apparatus according to claim 19, wherein the ratio of the minimum throughput of the first channel to the maximum throughput of the first channel is equal to the ratio of the value 1 to the R.
The device according to claim 19, wherein the determining module is further configured to:

Before the third image block is determined in each R image blocks of the plurality of image blocks according to the R, discrete cosine transform processing and/or quantization processing are performed on the plurality of image blocks, and / Or sort processing to obtain processed image blocks;

Perform joint compression on every R processed image blocks to obtain multiple image blocks after joint compression.
A data transmission device, characterized by comprising: a memory, a processor, and a radio frequency transceiver, the memory is used to store a program or instruction, when the program or instruction is executed by the processor, the device executes The method of any one of claims 1-12.
A computer-readable storage medium, characterized by comprising instructions, which when run on a computer, causes the computer to execute the method according to any one of claims 1-12.