CN117319684A

CN117319684A - Data transmission method, sending device, receiving device and system

Info

Publication number: CN117319684A
Application number: CN202311084995.XA
Authority: CN
Inventors: 谢文龙; 杨光; 安君超; 王艳辉
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2023-08-25
Filing date: 2023-08-25
Publication date: 2023-12-29

Abstract

The embodiment of the invention provides a data transmission method, a sending device, a receiving device and a system, wherein the method comprises the following steps: receiving a preset anti-packet-loss coding instruction, and carrying out anti-packet coding on multimedia data according to the preset anti-packet-loss coding instruction to obtain a plurality of coded data; generating a plurality of corresponding data packets to be transmitted based on the plurality of coded data, wherein the coded data is positioned at the front end of a data load in the data packets to be transmitted; and sending the plurality of data packets to be transmitted. The embodiment of the invention can reduce the problems that the third party terminal cannot normally analyze data and the data analysis cost is increased due to the format repackaging through the change of the package format position.

Description

Data transmission method, sending device, receiving device and system

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a data transmission method, a data transmitting apparatus, a data receiving apparatus, and a data transmission system.

Background

In the networking, the visual networking network adopts a four-layer eight-level networking architecture. However, in the project, the network needs to be extended to a village level unit to lay the video networking terminal, and the video networking terminal products in the village level unit need to be docked by adopting a video networking IP conversion system (hereinafter referred to as Vhub) mode, so that the network for docking the Vhub cannot be controlled. The link borne by the Vhub is an IP link, and the link may have poor conditions, so that a weak network environment is caused, and under the weak network environment, the audio and video data of a large code stream may have the problems of packet loss, screen blackout, blocking and the like. For example, the network built to village is an e-government external network, and the network condition is unstable, so that the use effect of the video networking terminal equipment is poor, and therefore the video networking terminal product is required to support the packet loss prevention function.

When the packet loss is determined, the existing video networking terminal products encode the subcode stream, and the encoded subcode stream is sent to the packet loss terminal, so that a certain packet loss resistance function is supported, however, in a conference, some mobile terminals, third party terminal products and the like which are accessed to the video networking conference through gateways (such as streaming media, video networking conference gateway xmcu and the like) exist, the subcode stream is received by the mobile terminals, the third party terminal products and the like, when the video networking watching terminal loses a packet, the speaking party can only send the encoded subcode stream, and the mobile terminals and the third party terminals can only receive the subcode stream after encoding.

However, coding the subcode stream of packet loss inevitably causes redundant data increase and encapsulation protocol change, in this case, the product and its external third party product are docked, and after receiving the coded subcode stream, the subcode stream is easy to make mistakes when decoding the coded subcode stream, resulting in incapability of viewing the subcode stream normally.

Disclosure of Invention

In view of the above problems, embodiments of the present invention have been made to provide a data transmission method, a data transmitting apparatus, a data receiving apparatus, and a data transmission system that overcome or at least partially solve the above problems.

In order to solve the above problems, in a first aspect, an embodiment of the present invention discloses a data transmission method, including:

receiving a preset anti-packet-loss coding instruction, and carrying out anti-packet coding on multimedia data according to the preset anti-packet-loss coding instruction to obtain a plurality of coded data;

generating a plurality of corresponding data packets to be transmitted based on the plurality of coded data, wherein the coded data is positioned at the front end of a data load in the data packets to be transmitted;

and sending the plurality of data packets to be transmitted.

As in the above method, optionally, the encoded data comprises original data or redundant data;

the data packet to be transmitted further includes: coding information, wherein the coding information is data information or identification information;

when the encoded data is original data, the encoded information is data information;

when the encoded data is redundant data, the encoded information is identification information.

As in the above method, optionally, when the encoded data is redundant data, the identification information is configured to a preset value.

In order to solve the above problem, in a second aspect, an embodiment of the present invention discloses a data transmission method, including:

Receiving a plurality of data packets coded according to a preset anti-lost packet coding mode, wherein each data packet comprises coded data, and the coded data is positioned at the front end of a data load in the data packet;

and analyzing a plurality of data packets to obtain a plurality of coded data.

Optionally, the data packet further includes coding information, where the coding information is data information or identification information;

the parsing the plurality of data packets to obtain the plurality of encoded data includes:

analyzing each data packet to obtain coding information and coding data in the data packet;

if the coded information is data information, determining that the coded data in the data load indicated by the data information is original data;

if the coded information is identification information, determining that coded data in the data load indicated by the identification information is redundant data;

and analyzing the original data and the redundant data according to the preset anti-lost packet coding mode to acquire the transmitted multimedia data.

The method as above, optionally, further comprising:

if the coding information in the data packet is identification information and the receiving end does not have preset anti-lost packet coding analysis capability, discarding the redundant data in the data load indicated by the identification information.

In order to solve the above problem, in a third aspect, an embodiment of the present invention discloses a data transmitting apparatus, including:

the coding module is used for receiving a preset anti-packet-loss coding instruction, and carrying out anti-packet coding on the multimedia data according to the preset anti-packet-loss coding instruction to obtain a plurality of coded data;

the processing module is used for generating a plurality of corresponding data packets to be transmitted based on the plurality of coded data, wherein the coded data are positioned at the front end of a data load in the data packets to be transmitted;

and the sending module is used for sending the plurality of data packets to be transmitted.

In order to solve the above-mentioned problems, in a fourth aspect, an embodiment of the present invention discloses a data receiving apparatus, including:

the receiving module is used for receiving a plurality of data packets coded according to a preset anti-lost packet coding mode, wherein each data packet comprises coding data, and the coding data is positioned at the front end of a data load in the data packet;

and the analysis module is used for analyzing the data packet and acquiring the plurality of coded data.

In order to solve the above-mentioned problem, a fifth aspect of the present invention discloses a data transmission system, which is characterized by comprising:

The data transmitting apparatus as described in the third aspect and at least one data receiving apparatus as described in the fourth aspect.

In order to solve the above-mentioned problem, a sixth aspect of an embodiment of the present invention discloses an electronic device, including:

one or more processors; and

one or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the electronic device to perform the data transmission method of the first aspect or the second aspect.

In order to solve the above-described problems, a seventh aspect of embodiments of the present invention provides a computer-readable storage medium storing a computer program causing a processor to execute the data transmission method according to the first aspect or the second aspect.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, the coded data is positioned at the front end of the data load in the transmitted data packet, the terminal with the anti-packet-loss decoding function can identify the original data through analysis by changing the position of the encapsulation format, and the received anti-packet-loss coded data can be analyzed according to the current data protocol for the receiving terminal without the anti-packet-loss decoding function, so that the problems that the third party terminal cannot normally analyze the data and the data analysis cost is increased due to the repackaging of the format are reduced, the protocol-level compatible matching capability is realized, and the project change range and influence are reduced.

Drawings

FIG. 1 is a flow chart of steps of an embodiment of a data transmission method of the present invention;

FIG. 2 is a schematic diagram of a prior art FEC encoded video data format;

fig. 3 is a schematic diagram of an FEC encoded video data format according to an embodiment of a data transmission method of the present invention;

fig. 4 is a schematic diagram of an FEC encoded audio data format according to an embodiment of a data transmission method of the present invention;

FIG. 5 is a flow chart of steps of another embodiment of a data transmission method of the present invention;

FIG. 6 is a flow chart of steps of yet another embodiment of a data transmission method of the present invention;

fig. 7 is a block diagram showing the structure of an embodiment of a data transmission apparatus of the present invention;

fig. 8 is a block diagram showing the structure of an embodiment of a data receiving apparatus of the present invention;

fig. 9 is a block diagram of a data transmission system embodiment of the present invention;

fig. 10 is a block diagram of an embodiment of an electronic device of the present invention.

Detailed Description

In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.

When the packet loss is determined, the existing video networking terminal products encode the subcode stream, and the encoded subcode stream is sent to the packet loss terminal, so that a certain packet loss resistance function is supported, however, in a conference, some mobile terminals, third party terminal products and the like which are accessed to the video networking conference through a gateway exist, the subcode stream is received by the mobile terminals, the third party terminal products and the like, when the video networking viewing terminal loses a packet, the speaking party can only send the encoded subcode stream, and the mobile terminals and the third party terminals can only receive the subcode stream after encoding.

In order to solve the problem, in the embodiment of the invention, after judging that the packet loss exists, a data sender performs packet loss resistant coding on the multimedia data according to a preset packet loss resistant coding instruction to obtain a plurality of coded data, and generates a plurality of corresponding data packets to be transmitted based on the plurality of coded data, wherein the coded data is positioned at the front end of a data load in the data packets to be transmitted; after the data receiver receives the transmitted data packet, if the data receiver has the anti-packet-loss encoding and decoding capability, the encoded data is directly decoded, if the data receiver does not have the anti-packet-loss encoding and decoding capability, as the encoded data is positioned at the front end of the data load in the data packet to be transmitted, the encoded data can be directly obtained according to the existing protocol, the terminal with the anti-packet-loss decoding function can analyze and identify the original data through the position change of the encapsulation format, and for the receiving terminal without the anti-packet-loss decoding function, the received anti-packet-loss encoded data can be analyzed according to the current data protocol, the problems that the third party terminal cannot analyze the data normally due to the format repackaging and the data analysis cost is increased are solved, and the protocol-level compatible matching capability is realized, so that the project change range and the influence are reduced.

Referring to fig. 1, a flowchart illustrating steps of an embodiment of a data transmission method of the present invention is applied to a data sender, and may specifically include the following steps:

step S110, receiving a preset anti-packet-loss coding instruction, and carrying out anti-packet coding on multimedia data according to the preset anti-packet-loss coding instruction to obtain a plurality of coded data;

specifically, after a packet loss phenomenon occurs in a data transmission process, the server may send a preset packet loss prevention coding instruction to the data sender, instruct the data sender to perform packet loss prevention coding on the transmitted data, and after the data sender receives the preset packet loss prevention coding instruction, perform packet loss prevention coding on the multimedia data according to the preset packet loss prevention coding instruction to obtain a plurality of coded data, where the preset packet loss prevention coding instruction may include one of a plurality of packet loss prevention codes.

For example, if the preset anti-packet-loss code is forward error correction (Forward Error Correction, FEC) code, the sender performs anti-packet-loss coding on the multimedia data according to the FEC coding mode, so as to obtain a plurality of FEC coded data.

Specifically, FEC is a technique for controlling transmission errors in a unidirectional communication system, where a sender sends data to be sent together with a certain redundancy error correction code, and a receiver performs error detection on the received data according to the error correction code, and if errors are found, the receiver performs error correction. The FEC packet group head can be expanded on the custom field of the transmission protocol, a group is a complete FEC processing unit which is mutually independent, and consists of k media packets and r redundant packets, each packet in the group has a group number, whether the group loses a data packet or not is judged according to the continuity of the group number, and the recovery is carried out selectively, if the redundant packet is lost, the recovery is not needed. The FEC coding redundancy is defined as the ratio of the number r of redundant packets to the number k of original media packets, and the higher the redundancy is, the stronger the anti-packet loss capability is, but the transmission efficiency is correspondingly reduced, so that the FEC algorithm is a compromise consideration of the transmission efficiency and the anti-packet loss capability. Conditions for packet loss recovery: the number of received media packets+the number of received redundant packets > = the number of group original media packets, and the packet loss can be recovered as long as the above conditions are satisfied. For example, in the data transmission process of the video-networking conference, including an speaking terminal (data sender), a receiving terminal (data receiver) and a server, 2 channels are required for transmission because the video-networking terminal has limited encoding and decoding capabilities and the main code stream and the subcode stream are already encoded in the conference. Coding one audio/video resource consumes coding performance of the video networking terminal and requires an additional channel for distinguishing transmission. The other mobile terminals and third party terminal products which are accessed to the video networking conference through the gateway and the like receive the subcode streams which are not coded, so that in order to improve the use effect of the video networking terminal, the video networking watching terminal receives the main code stream in the conference, and the mobile terminals and the third party terminal products receive the subcode streams in the conference. That is, the main code stream receiving terminal normally receives the main code stream transmitted from the speaking terminal, and the sub-code stream receiving terminal receives the sub-code stream transmitted from the speaking terminal at any time.

Because the network of the video network is uncontrollable aiming at the network of the Vhub docking, the network condition is unstable, and the use effect of the video network terminal equipment is poor, the video network terminal product is required to support the packet loss prevention function so as to cope with the unstable network condition of the electronic government affair external network. In order to solve this problem, a server in the video conference needs to detect whether a video viewing terminal (a main code stream receiving terminal) has a packet loss condition or not and determine the packet loss terminal (a first main code stream receiving terminal), where the server in the video conference may control a parameter conference control software for the video conference.

Specifically, the server sends a packet loss rate reporting instruction to the main code stream receiving terminal in the current conference, and the packet loss rate reporting instruction is used for counting the packet loss condition of the main code stream receiving terminal in the conference. After receiving the packet loss rate reporting instruction, the main code stream receiving terminal detects whether the audio and video packet is lost, detects once every interval for a period of time, and reports the packet loss rate to the server if the packet loss rate is continuously detected for a plurality of times, and only reports once if the audio and video packet is simultaneously lost.

After receiving the packet loss rate returned by each main code stream receiving terminal, the server determines the number of the main code stream receiving terminals with packet loss. And the server judges whether the link problem exists between the sending end and the server or between the server and a certain receiving terminal according to the number of the main code stream receiving terminals with packet loss in the current conference, so that different packet loss resistant strategies are adopted.

When a packet loss occurs in a single or a small number of main code stream receiving terminals, namely, when the number of the main code stream receiving terminals with the packet loss is smaller than a first preset threshold value, judging that the link between the server and the main code stream receiving terminals is a problem, and taking the main code stream receiving terminal with the packet loss as a first main code stream receiving terminal.

When the number of the main code stream receiving terminals with packet loss is larger than a second preset threshold value, judging that the link between the transmitting end and the server is in problem, taking all the main code stream receiving terminals as first main code stream receiving terminals.

And according to the positioned uplink and downlink blocking problem, scheduling and distributing the main code stream and the sub code stream of the FEC code, performing FEC code on the sub code stream only, keeping the main code stream unchanged, and transmitting the sub code stream after the code to a determined first main code stream receiving terminal.

The dispatching server analyzes and counts the quantity of the uplink and downlink packet loss terminals and the corresponding packet loss proportion, and judges and positions uplink or downlink blocking, FEC coding enabling of dispatching terminals and relevant dispatching of main code streams and subcode streams.

And counting the current packet loss condition through the viewing terminal of the video network in the conference, and reporting to the scheduling server. The scheduling server judges whether the link problem between the sending end and the server or the link problem between the server and a certain watching terminal exists or not according to the number of the video networking terminals with the packet loss condition in the video networking watching terminal in the current meeting, so that different packet loss resistant strategies are adopted.

And when the packet loss occurs in the individual or small quantity of viewing video networking terminals, judging that the link problem between the server and the video networking viewing terminals exists. The server informs the speaking terminal that the maximum occupied bandwidth of each path of video of the subcode stream is not more than 1.8Mbps through FEC coding subcode stream, the occupied bandwidth of each path of video is between 1.1Mbps (CIF, 300K) and 1.8Mbps (D1, 500K), and the video is sent to the corresponding video networking watching terminal. Other video networking conference terminals still view the main code stream.

And judging that the link problem between the transmitting end and the server exists after the number of the video networking watching terminals with the packet loss reaches a certain threshold. The server informs the speaking terminal to send the speaking terminal to all viewing terminals through the FEC code subcode stream, wherein the speaking terminal comprises all viewing terminals of the video network and all viewing terminals of the third party.

In the embodiment of the invention, the main code stream and the sub code stream of the FEC code are scheduled and distributed according to the problem of uplink and downlink blocking of positioning, and the FEC code is only carried out on the sub code stream, so that the main code stream is kept unchanged, and the coding resource is saved while the packet loss resistance function is added.

Step S120, generating a plurality of corresponding data packets to be transmitted based on the plurality of coded data, wherein the coded data is positioned at the front end of a data load in the data packets to be transmitted;

Specifically, the sender generates a plurality of data packets to be transmitted by encoding the encoded data formed by the preset encoding instruction, and in practical application, the sender may generate m encoded data for n pieces of multimedia data to be transmitted based on the preset encoding instruction, and generate m data packets to be transmitted based on the m encoded data, where m > n, that is, the sender may generate more data packets to be transmitted (including the original data packet and the redundant data packet) based on the originally transmitted multimedia data. Unlike the prior art, in the data payload of the data packet to be transmitted, the encoded data is located at the front end of the data payload, and the encoded packet header is located at the rear end of the data payload.

For example, after FEC encoding is performed on the subcode stream in the conference by the conference speaking terminal, FEC encoded data and FEC data packet headers are written in a data payload of the conference data protocol, FEC encoded identifiers are identified in a corresponding field of the conference data protocol, and the FEC data packet headers are located after the FEC encoded data in the data payload. The conference speaking terminal takes the FEC code stream generated based on the conference data protocol as the sub-code stream after coding.

Taking the internet of view as an example, referring to fig. 2, a schematic diagram of FEC-encoded video data format in the prior art is shown, when there is packet loss at the viewing terminal of the internet of view, the speaking party sends the subcode stream after FEC encoding, and the third party terminal can only receive the subcode stream after FEC encoding. Additional FEC encoding will necessarily result in data fluctuations, causing redundant data additions and encapsulation protocol changes. Under the condition, products which are in butt joint, such as a video networking terminal, a mobile terminal, a third party terminal and the like which cannot support FEC encoding and decoding due to non-upgrading, receive the encoded subcode stream, and make mistakes when decoding the encoded subcode stream, and cannot normally watch the subcode stream, so that the terminal needs to normally analyze the encoded subcode stream, and corresponding changes are needed to be made to be compatible with the adjustment of the scheme. The product area involved in the change of the packet loss prevention strategy scheme in the weak network environment is greatly increased, and the solution is not optimal.

Therefore, when the video networking terminal product supports the packet loss prevention function, the unstable network condition of the e-government external network is considered, and other equipment functions are compatible. In the embodiment of the invention, the existing anti-packet loss code is improved. The anti-lost packet coding data format corresponding to video data and audio data existing in the video network conference is respectively adjusted, the coding data is placed at the front end of the data load of the data packet, so that the video network terminal can decode according to the decoding mode corresponding to the anti-lost packet coding, and for other terminals which do not support the anti-lost packet coding and decoding, as the coding data is positioned at the front end of the data load of the data packet, the coding data is analyzed according to the existing transmission protocol, errors do not occur, and various terminal devices in the video network are compatible. Referring to fig. 3, a schematic diagram of an FEC encoded Video data format according to an embodiment of a data transmission method of the present invention is shown, where a maximum payload length of Video data of a Video packet header (VVP) of a Video network protocol is 1024 bytes, and an ethernet frame length is fixed to 1092 bytes in a Video packet data block diagram and format of a Video network where an FEC switch is turned on. The FEC header is placed in the last part of the VVP payload, and the FEC encoded video data is placed in the front of the VVP payload.

Referring to fig. 4, a schematic diagram of an FEC encoded Audio data format according to an embodiment of the data transmission method of the present invention is shown, in a video-over-internet Audio packet data block diagram and format in which an FEC switch is turned on, a VVP Audio data payload length is 256 bytes at maximum, an ethernet frame length is fixed to 324 bytes, an FEC header is placed at the last part of the VVP payload, and FEC encoded Audio data is placed at the front end of the VVP payload.

The Video packet data protocol specification of the Video network with FEC switch on is shown in table 1: video data takes 1000 bytes and FEC data packet header takes 24 bytes.

Table 1 Video packet data protocol specification for Video network with FEC switch on

Data type	Number of occupied bytes	Description of the invention
			Video data	1000	Video data
FEC data packet head	24	Coding type

The video network Audio packet data protocol specification of the FEC switch is shown in table 2: video data occupies 232 bytes, and FEC data packet header occupies 24 bytes.

Table 2 video networking Audio packet data protocol specification for opening FEC switch

The FEC header protocol specification is shown in table 3:

table 3FEC header protocol specification

According to the protocol specification, the conference speaking terminal can perform FEC coding on the video stream subcode stream or the audio stream subcode stream in the video networking conference, and determine the subcode stream after coding in the conference.

Step S130, transmitting the plurality of data packets to be transmitted;

specifically, the data sender sends out the generated data packets to be transmitted. After the data receiver receives the transmitted data packet, the data packet is parsed, and the original data is obtained.

In practical application, the data sender may send a plurality of data packets to be transmitted to the server, and the data sender may forward the data packets to the data receiving device that needs to receive the data packets to be transmitted.

Taking the video networking as an example, the conference speaking terminal sends the generated data packets to be transmitted to the server as encoded subcode streams, and the server sends the received encoded subcode streams to the first main code stream receiving terminal and all subcode stream receiving terminals. After the first main code stream receiving terminal receives the encoded subcode stream, the received subcode stream is analyzed according to the FEC encoded data to obtain a conference data stream. After all subcode stream receiving terminals receive the coded subcode streams, the received subcode streams are analyzed according to the conference data protocol to obtain conference data streams. For the first main code stream receiving terminal, decoding is carried out according to an FEC decoding mode to obtain decoded data, the problem of packet loss of the main code stream receiving terminal is solved, and for the sub-code stream receiving terminal, the received sub-code stream is analyzed by using the existing conference data protocol and no new change is generated, so that other various terminals which do not support FEC encoding and decoding are well compatible. In the embodiment of the invention, the coded data is positioned at the front end of the data load in the transmitted data packet, the terminal with the anti-packet-loss decoding function can identify the original data through analysis by changing the position of the encapsulation format, and the received anti-packet-loss coded data can be analyzed according to the current data protocol for the receiving terminal without the anti-packet-loss decoding function, so that the problems that the terminal without supporting FEC (forward error correction) coding and decoding cannot normally analyze the data and the data analysis cost is increased due to format repackaging are solved, the protocol level compatible matching capability is realized, and the project fluctuation range and influence are reduced.

In a preferred embodiment of the invention, the encoded data comprises raw data or redundant data;

And when the coded data are redundant data, configuring the identification information as a preset value.

Specifically, after performing anti-packet encoding on the multimedia data according to a preset anti-packet encoding instruction, the data sender determines a plurality of encoded data, where the plurality of encoded data may include original data or redundant data.

And when the data sender generates a plurality of data packets to be transmitted based on a plurality of coded data, writing coded information into the data packets to be transmitted, wherein the coded information is data information or identification information, when the coded information is the data information, the coded data in the data packets are represented as original data, namely multimedia data, and when the coded information is the identification information, the coded data in the data packets are represented as redundant data.

After the data receiver receives the transmitted data packet, the data receiver can judge whether the currently received data packet is redundant data or original data according to whether the coding information is a preset value.

The data receiver has preset anti-lost packet coding and decoding capability, decodes the received data packets after receiving the redundant data, and analyzes the redundant data and the received partial original data to obtain all the original data;

when the data receiver does not have the preset anti-lost packet coding and decoding capability, discarding the data packet corresponding to the received redundant data after receiving the redundant data; when the original data is received, the original data is directly obtained from the data packet.

Taking the video networking as an example, the conference speaking terminal can set coding information by using a payload length field in a conference data protocol, if the payload length recorded in the payload length field is 0, the conference speaking terminal indicates that original data does not exist in a current data packet, namely, the current data packet carries redundant data, and if the payload length recorded in the payload length field is greater than 0, the conference speaking terminal indicates that the current data packet records data with the effective length, namely, the current data packet carries the original data, and the length of the carried original data is the length recorded in the payload.

As shown in fig. 3, the data selection may be performed according to the payload length field payload_len in VVP, for example, payload_len=0, which represents that the current data packet is an FEC redundancy packet, and the FEC redundancy packet is a data packet additionally introduced in FEC encoding, and is not a packet body carrying original data, so that payload_len=0 may be used as an identifier of a packet body carrying original data in a non-FEC encoding mode, that is, payload_len=0 indicates that all data carried in the FEC encoding mode is an FEC redundancy packet, and FEC decoding is required to obtain an identifier of the packet body of the original data packet. When the length of the VVP Video data payload is 1024 bytes at maximum and payload_len >0, the value of payload_len represents the size of the original data to be carried, and is counted from the end of the VVP Video header. The FEC header is placed at the end of the original data so that a third party terminal or mobile terminal can intercept the original video data of the correct length from the beginning according to the value of payload_len.

As shown in fig. 4, the data selection may be performed according to the data payload length field payload_len in VVP. If payload_len=0, it represents that the current data packet is an FEC redundancy packet, where the FEC redundancy packet is an additional data packet introduced in FEC encoding, and is not a packet body carrying original data, so that payload_len=0 can be used as an identifier of a packet body carrying original data in a non-FEC encoding mode, and payload_len=0 indicates that all data carried in the FEC encoding mode is an FEC redundancy packet, and FEC decoding is required to obtain an identifier of the packet body of the original data packet. When the length of the VVP Audio data payload is 256 bytes at maximum and payload_len >0, the value of payload_len represents the size of the original data to be carried, and is counted from the end of the VVP Audio header. The FEC header is placed in the last part of the original data so that a third party product or mobile terminal can intercept the original audio data of the correct length according to the value of payload_len.

After receiving the encoded subcode stream, a first main code stream receiving terminal in the video networking conference analyzes the data according to the conference data protocol, determines the effective load length, and if the effective load length is 0, acquires all FEC encoded data as redundant data, analyzes the redundant data, and determines decoded original data. If the payload length is greater than 0, the original data of the payload length is intercepted from the encoded subcode stream.

In practical application, after receiving the encoded subcode stream, the subcode stream receiving terminal determines the payload length according to the audio/video data format in the conference, and if the payload length is 0, the subcode stream is directly discarded. If the payload length is greater than 0, the original data of the payload length is intercepted from the received subcode stream.

Taking the Video networking as an example, the VVP Video data payload length is 1024 bytes at maximum, payload_len >0 represents carrying the original data, and the FEC header is placed at the end of the original data from the beginning after the VVP Video header. payload_len=1000 represents the original data carrying the FEC header, the valid data being 1000 bytes, immediately following the VVP video header.

After receiving the protocol format data, the viewing terminal of the video network supporting the FEC encoding and decoding carries out identification judgment according to the payload_len in the VVP:

(1) the payload_len=0 carries redundant data, 1000 redundant data are obtained, FEC decoding operation is carried out on the 1000 redundant data, and real data are restored

(2) payload_len >0 intercepts the payload_len raw data. For example, payload _ len=800,

the original data of 800 length is intercepted.

After receiving the protocol format data, the viewing terminal, the third party terminal or the mobile terminal of the video network which does not support FEC encoding and decoding carries out identification judgment according to the payload_len in the VVP:

(1) payload_len=0 carries redundant data, which is discarded directly.

(2) The payload_len >0 intercepts the payload_len raw data and proceeds to the next step according to the raw data.

Similarly, for the audio data stream, the payload_len=0 carries redundant data, the video networking viewing terminal obtains 232 the redundant data, and the payload_len >0 intercepts the payload_len original data.

Therefore, for a third party product which always receives the subcode stream, a mobile terminal and a video networking terminal which does not support FEC encoding and decoding, the data interception is only needed according to the original video networking audio-video protocol VVP protocol and the payload_len.

In the embodiment of the invention, when the visual networking terminal products are paved in village administrative units, the Vhub (the butted visual networking terminal products supporting FEC encoding and decoding can still provide smooth audio and video services in a weak network environment, and the visual networking terminal which does not support FEC encoding and decoding, the third party terminal and the mobile terminal are compatible, so that the video decoding watching can be normally carried out.

Referring to fig. 5, a step flow chart of an embodiment of a method for implementing packet loss prevention in another conference mode of the present invention is shown, and the method is applied to the internet of view, and may specifically include the following steps:

A1, the parameter control software checks the monitoring packet loss terminal and sends a packet loss starting report instruction;

step A2, packet loss reporting, wherein the video-on-demand terminal detects whether the audio and video are lost after receiving a packet loss reporting instruction, detects the packet loss once every 2s, continuously detects the packet loss 2 times, and reports the packet loss rate to the parameter conference control software (if the audio and video are simultaneously lost, only one time is required to report);

a3, transmitting an FEC coding starting instruction to the speaking terminal by the pamir control software, and triggering FEC coding of the audio and video subcode streams by the speaking terminal with reported packet loss;

step A4, the pamir control software dispatches the subcode stream of the watching terminal to the watching packet loss terminal;

step A5, the session management server performs autonomous scheduling on the subcode stream subjected to FEC coding by the speaking terminal;

and A6, the packet loss terminal watches the subcode stream which is subjected to FEC coding, and the mobile terminal watches the subcode stream which is subjected to FEC coding.

And A7, the non-packet loss terminal watches the main code stream of the non-FEC code.

Through the steps, the packet loss prevention function of the video networking terminal is guaranteed, and the third party product can be prevented from being changed, so that the third party terminal normally analyzes and receives the subcode stream after FEC coding.

Referring to fig. 6, a flowchart illustrating steps of yet another embodiment of a data transmission method of the present invention, applied to a data receiving party, may specifically include the following steps:

Step S610, receiving a plurality of data packets encoded according to a preset anti-lost packet encoding mode, wherein each data packet comprises encoded data, and the encoded data is positioned at the front end of a data load in the data packet;

and S620, analyzing a plurality of data packets to obtain a plurality of encoded data.

Specifically, after a packet loss phenomenon occurs in a data transmission process, the server may send a preset packet loss prevention coding instruction to the data sender, instruct the data sender to perform packet loss prevention coding on the transmitted data, and after the data sender receives the preset packet loss prevention coding instruction, perform packet loss prevention coding on the multimedia data according to the preset packet loss prevention coding instruction, so as to obtain a plurality of coded data.

The sender generates a plurality of data packets to be transmitted by encoding the encoded data formed by the preset encoding instructions, and unlike the prior art, in the data load of the data packets to be transmitted, the encoded data is located at the front end of the data load, and the encoding packet header is located at the rear end of the data load. And then the data sender sends out the generated data packets to be transmitted.

After the data receiving party receives the transmitted data packet, the data receiving party analyzes the data packet to obtain a plurality of encoded data, and the original data is restored from the encoded data.

In a preferred embodiment of the present invention, the data packet further includes coding information, where the coding information is data information or identification information;

In a preferred embodiment of the invention, the method further comprises:

In the embodiment of the invention, the redundant data is distinguished by adopting protocol field identification and encapsulation format position change, so that the problems that a third party terminal cannot normally analyze data and the data analysis cost is increased due to format repackaging are solved, the compatibility matching capability of a protocol level is realized, and the project change range and influence are reduced.

It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.

Referring to fig. 7, a block diagram of an embodiment of a data transmission apparatus according to the present invention is shown, and may specifically include the following modules:

the encoding module 710 is configured to receive a preset anti-packet-loss encoding instruction, and perform anti-packet encoding on the multimedia data according to the preset anti-packet-loss encoding instruction to obtain a plurality of encoded data;

a processing module 720, configured to generate a plurality of corresponding data packets to be transmitted based on the plurality of encoded data, where the encoded data is located at a front end of a data payload in the data packets to be transmitted;

and a sending module 730, configured to send the plurality of data packets to be transmitted.

Referring to fig. 8, a block diagram of an embodiment of a data receiving device of the present invention is shown, and may specifically include the following modules:

the receiving module 810 is configured to receive a plurality of data packets encoded according to a preset anti-packet encoding manner, where each data packet includes encoded data, and the encoded data is located at a front end of a data load in the data packet;

and the parsing module 820 is configured to parse the data packet to obtain the plurality of encoded data.

Referring to fig. 9, a block diagram of an embodiment of a data transmission system according to the present invention is shown, which may specifically include:

a data transmitting device 910 and a data receiving device 920.

For the device embodiments and the system embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.

Referring to fig. 10, there is shown a block diagram of an embodiment of an electronic device of the present invention, the device comprising: a processor 1010, a machine-readable medium 1020, and a bus 1030;

wherein the processor 1010 and the machine-readable medium 1020 communicate with each other via the bus 1030;

the processor 1010 is configured to invoke program instructions in the machine-readable medium 1020 to perform the methods provided by the method embodiments described above, including, for example: receiving a preset anti-packet-loss coding instruction, and carrying out anti-packet coding on multimedia data according to the preset anti-packet-loss coding instruction to obtain a plurality of coded data; generating a plurality of corresponding data packets to be transmitted based on the plurality of coded data, wherein the coded data is positioned at the front end of a data load in the data packets to be transmitted; and sending the plurality of data packets to be transmitted.

Embodiments of the present invention disclose a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the methods provided by the method embodiments described above, for example comprising: receiving a preset anti-packet-loss coding instruction, and carrying out anti-packet coding on multimedia data according to the preset anti-packet-loss coding instruction to obtain a plurality of coded data; generating a plurality of corresponding data packets to be transmitted based on the plurality of coded data, wherein the coded data is positioned at the front end of a data load in the data packets to be transmitted; and sending the plurality of data packets to be transmitted.

Embodiments of the present invention provide a non-transitory computer readable storage medium storing computer instructions that cause a computer to perform the methods provided by the above-described method embodiments, for example, including: receiving a preset anti-packet-loss coding instruction, and carrying out anti-packet coding on multimedia data according to the preset anti-packet-loss coding instruction to obtain a plurality of coded data; generating a plurality of corresponding data packets to be transmitted based on the plurality of coded data, wherein the coded data is positioned at the front end of a data load in the data packets to be transmitted; and sending the plurality of data packets to be transmitted.

In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.

It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.

The foregoing has described in detail a data transmission method, a data transmission device, a data receiving device and a data transmission system according to the present invention, and specific examples are provided herein to illustrate the principles and embodiments of the present invention, and the above examples are only for aiding in understanding the method and core idea of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims

1. A data transmission method, comprising:

and sending the plurality of data packets to be transmitted.

2. The data transmission method according to claim 1, wherein the encoded data includes original data or redundant data;

3. The data transmission method according to claim 2, wherein the identification information is configured to a preset value when the encoded data is redundant data.

4. A data transmission method, comprising:

And analyzing a plurality of data packets to obtain a plurality of coded data.

5. The data transmission method according to claim 4, wherein the data packet further includes encoded information, the encoded information being data information or identification information;

6. The data transmission method according to claim 5, further comprising:

7. A data transmission apparatus, comprising:

8. A data receiving apparatus, comprising:

9. A data transmission system, comprising:

the data transmitting apparatus according to claim 7 and at least one data receiving apparatus according to claim 8.

10. An electronic device, comprising:

One or more processors; and

one or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the apparatus to perform the data transmission method of any of claims 1 to 3 or 4 to 6.

11. A computer-readable storage medium, characterized in that a computer program stored therein causes a processor to execute the data transmission method according to any one of claims 1 to 3 or 4 to 6.