CN102256128B - Synchronous decoding method and device - Google Patents
Synchronous decoding method and device Download PDFInfo
- Publication number
- CN102256128B CN102256128B CN 201110202743 CN201110202743A CN102256128B CN 102256128 B CN102256128 B CN 102256128B CN 201110202743 CN201110202743 CN 201110202743 CN 201110202743 A CN201110202743 A CN 201110202743A CN 102256128 B CN102256128 B CN 102256128B
- Authority
- CN
- China
- Prior art keywords
- decoder
- decoding
- synchronization
- synchronous
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000001360 synchronised effect Effects 0.000 title claims abstract description 99
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000012544 monitoring process Methods 0.000 claims abstract description 25
- 239000000872 buffer Substances 0.000 claims description 13
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Landscapes
- Synchronisation In Digital Transmission Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a synchronous decoding method and a synchronous decoding device, which are applied to a video monitoring system. The method provided by the invention comprises that: at the beginning of a decoding synchronizing cycle, a master decoder determines a decoding reference according to a current decoded frame, and transmits the decoding reference to each slave decoder, and the slave decoders determine the decoding reference according to the decoding reference and network delay, and perform decoding according to the determined decoding reference. Another method provided by the invention comprises that: at the end of the decoding synchronizing cycle, each decoder determines the decoding reference according to the current decoded frame, and transmits the decoding reference to each other decoder; and each other decoder elects the main decoder of the decoding synchronizing cycle, determines the decoding reference according to the decoding reference determined by the main decoder and the network delay, and performs the decoding according to the decoding reference. By the method and the device, decoding synchronization can be realized.
Description
Technical Field
The present invention relates to video monitoring technology in the field of communication technology, and in particular, to a synchronous decoding method and apparatus in a video monitoring system.
Background
The video monitoring system gradually replaces the traditional analog video monitoring system with the advantages of flexible control, large information capacity, convenient storage and retrieval and the like, and is widely applied to the aspects of monitoring, security protection, quality inspection and the like. With the development and popularization of computer and network technologies and the rapid expansion of network bandwidth, video monitoring has been developed into a network multimedia monitoring system, i.e., a digital video monitoring technology is combined with a network technology, and a local area network or Internet remote monitoring function is realized under the condition that a field monitoring host is unattended. The monitoring service is developed from the traditional simulation monitoring to the network monitoring, the application scene and range are continuously expanded, and the monitoring service is developed from the original local specific area to cover the whole garden, street and city, even a plurality of cities.
As shown in fig. 1, the encoder, the decoder, the management server, and other devices in the video monitoring system implement interconnection through a network. The management server is used for managing each encoder and decoder. The live code stream is sent from the encoder to the decoder, and in the actual transmission process, the live code stream may pass through a plurality of network devices, and the time delay introduced by the network through which each live code stream passes is not completely the same. The decoder and encoder may be one device or may be one software module. The live code stream of the encoder is transmitted to the decoders through the network, and each decoder receives and decodes the live code stream.
The network paths from the encoder to the decoder are different, and the delay is inevitably introduced in the transmission process of the code stream. The decoder receives the live code stream and immediately decodes and outputs the live code stream. Because the code stream introduces time delay through the network, when different decoders really decode and display, things happening at the same moment actually will be displayed at different reference times on different displays, which affects the judgment of the user on the live condition.
Disclosure of Invention
The invention provides a synchronous decoding method and a device thereof, which are used for solving the problem of asynchronous decoding caused by network delay introduced in the network transmission process to a certain extent.
The synchronous decoding method provided by the invention is applied to a video monitoring system and comprises the following steps:
appointing a main decoder in a decoder in advance, and the rest are slave decoders;
when the decoding synchronization period is reached, the main decoder determines a decoding reference according to the decoded current frame and sends a synchronization message to the slave decoder, wherein the synchronization message carries the decoding reference information determined by the main decoder; and the slave decoder determines a decoding reference according to the decoding reference information and the network delay carried in the synchronous message and decodes the received code stream according to the determined decoding reference.
The decoder provided by the invention is applied to a video monitoring system and comprises:
the first synchronous reference determining module is used for determining a decoding reference according to a decoded current frame when the decoder is used as a main decoder and a decoding synchronous period is reached;
the synchronous message sending module is used for sending a synchronous message to the slave decoder when the decoder is used as a master decoder, wherein the synchronous message carries the decoding reference information determined by the master decoder;
the synchronous message receiving module is used for receiving a synchronous message sent by a main decoder when the decoder is used as a slave decoder, wherein the synchronous message carries decoding reference information determined by the main decoder;
a second synchronization reference determining module, configured to determine, when the decoder is used as a slave decoder, a decoding reference according to decoding reference information and network delay carried in the synchronization packet;
and the decoding module is used for decoding the received code stream when the decoder is used as a master decoder, and decoding the received code stream according to the decoding reference determined by the second synchronous reference determination module when the decoder is used as a slave decoder.
The invention provides another synchronous decoding method applied to a video monitoring system, which comprises the following steps:
when a decoding synchronization period arrives, each decoder determines a decoding reference according to a decoded current frame and sends a synchronization message to other decoders, wherein the synchronization message carries the decoding reference determined by the decoder;
after receiving the synchronous messages sent by other decoders, each decoder elects a main decoder of the decoding synchronous period, determines a decoding reference according to the decoding reference determined by the main decoder and network delay, and decodes the received code stream according to the determined decoding reference.
The invention provides another decoder applied to a video monitoring system, which comprises:
the first synchronous reference determining module is used for determining a decoding reference according to a decoded current frame when a decoding synchronous period arrives;
the synchronous message sending module is used for sending a synchronous message to other decoders, wherein the synchronous message carries the decoding reference determined by the first synchronous reference determining module;
the synchronous message receiving module is used for receiving synchronous messages sent by other decoders, wherein the synchronous messages carry decoding standards determined by a synchronous message sender decoder;
a second synchronization reference determining module, configured to select a main decoder of the decoding synchronization period after the synchronization packet receiving module receives a synchronization packet sent by another decoder, and determine a decoding reference according to the decoding reference determined by the main decoder and a network delay;
and the decoding module is used for decoding the received code stream according to the decoding standard determined by the second synchronous reference module.
The beneficial technical effects of the invention comprise:
because the network delay is used as a reference when the decoding reference is determined, the influence of the network delay on the decoding synchronization is eliminated to a certain extent, and compared with the prior art, the decoding synchronization precision is improved.
Drawings
FIG. 1 is a diagram illustrating a networking architecture of a video surveillance system in the prior art;
FIG. 2 is a flowchart illustrating an encoder synchronizing a reference time according to an embodiment of the present invention;
fig. 3, fig. 4 and fig. 5 are schematic diagrams illustrating a decoding synchronization process according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a synchronization packet in the first embodiment of the present invention;
FIG. 7 is a schematic diagram of a decoding synchronization process according to a second embodiment of the present invention;
FIG. 8 is a block diagram of a decoder according to a first embodiment of the present invention;
fig. 9 is a schematic structural diagram of a decoder suitable for the second embodiment of the present invention.
Detailed Description
The video monitoring system architecture applied in the embodiment of the present invention may be as shown in fig. 1, where the management server is configured to manage each encoder and decoder, specify the trend of the live stream, and configure a decoding reference synchronization policy and an equipment time synchronization policy.
The encoders and decoders remain time synchronized. The specific synchronization method may be as follows: each device uniformly adopts an NTP (Network Time Protocol) server to carry out Time synchronization; or the devices register with the same management server and then maintain time synchronization with the server.
When a client requests to access a video stream (namely a live stream) coded by the coder in real time, the live stream of the coder is transmitted to the decoders through the network, and each decoder receives and decodes the live stream. In this process, there may be two reasons for the decoding to be out of synchronization: on the one hand, in some cases, when each encoder encodes a live scene, the time points of encoding are not strictly consistent; on the other hand, as the code stream introduces time delay through the network, when different decoders really decode and display, things happening at the same moment actually will be displayed at different reference times on different displays, which affects the judgment of the user on the live condition.
Some code streams only provide relative time information, for example, the current frame is the second frame. If the encoder uses different reference times for encoding, the following situation may occur: the first frame of encoder 1 and the first frame of encoder 2 are not encoded at a reference time. If the decoders all decode the first frame synchronously, the actual output live is not displayed at the same time point.
In view of the above problem of asynchronous coding of the encoders, the embodiments of the present invention adopt the following solutions to synchronize the coding of the encoders by unifying the coding reference times of the encoders.
Solution 1 for code synchronization: the management server sets encoding reference time of each encoder, for example, 000 seconds of the current time as the encoding reference time, and then issues the encoding reference time to each encoder, so that each encoder encodes according to the issued encoding reference time.
Solution 2 for code synchronization: as shown in fig. 2, encoders that need to be synchronized are designated in advance, and one of the encoders is designated as a master encoder; and the main encoder transmits the coding reference time to other encoders, so that the other encoders encode according to the transmitted coding reference time.
The solution 1 for coding synchronization is simple in arrangement and convenient to implement, and is better than the solution 2.
Aiming at the problem of asynchronous decoding, the embodiment of the invention unifies the current decoding reference time of each decoder by synchronizing the current decoding reference time, thereby achieving the purpose that each decoder uniformly decodes the live stream at the same reference time.
Fig. 3 is a schematic diagram of a decoding synchronization process in the video monitoring system according to an embodiment of the present invention. Before decoding a video code stream, allocating roles for decoders in a video monitoring system, namely, designating one decoder as a master decoder and the other decoders as slave decoders, wherein the master decoder is responsible for issuing a decoding reference to each slave decoder, and each slave decoder determines the respective decoding reference according to the master decoder and network delay and uses the decoding reference as a basis for decoding synchronization. As shown, when the decoding synchronization period arrives, the process may include:
In the above flow, the decoding reference determined by the master decoder may be the encoding time of the current frame, and in this case, each slave decoder adds the network delay with the master encoder to obtain the decoding reference on the basis of the time indicated by the time information carried in the synchronization packet. The decoding standard determined by the master decoder may also be the number of the current frame, and in this case, each slave decoder adds the product of the network delay and the frame rate with the master encoder on the basis of the frame number carried in the synchronization packet to obtain the decoding standard.
In the above flow, the network delay from the decoder to the master decoder may be determined based on empirical values. A more accurate method is: the master decoder carries the current time of sending the synchronous message in the synchronous message, so that the slave decoder calculates the network delay according to the current time of receiving the message and the time of sending the synchronous message by the master decoder.
In order to more clearly illustrate the implementation and synchronization principle of the first embodiment of the present invention, the following is further described with reference to fig. 4 and 5.
As shown in fig. 4 and 5, during one decoding synchronization period, the operations at the time points are as follows:
f1: time A: the encoder 1 encodes the live stream at time a and then sends the live stream 1 over the network to the main decoder: a decoder 1.
F2: time 1: the decoder 1 receives the live stream 1 and buffers it.
F3: time 2: the decoder 1 decodes the live stream in the buffer. The decoder decodes the code stream according to a preset speed, and determines the time of the decoded current frame as a reference time, namely reference time A.
F4: time 3: the decoder 1 sends a synchronization message to the decoder 2 to inform the decoder 2 that the reference time of the current decoding code stream is time a. Optionally, the synchronization packet may also carry the current time of the decoder 1, so as to perform network delay calculation. Fig. 6 shows a sync message format.
F5: time 4: the decoder 2 analyzes the received synchronous message and knows that the reference time of the current decoding code stream of the decoder is time A. The synchronization messages are transmitted from decoder 1 to decoder 2, introducing network latency. If the decoder 2 decodes according to the time a as the reference time, the decoder 1 has already decoded according to the new reference time and finally decoded the output, still out of synchronization. The decoder 2 calculates the decoding reference time and needs to take into account the network delay (time 4-time 3). The decoder 2 calculates the decoding reference time of the current code stream, wherein:
when time a is in units of time, decoder 2 determines the reference time according to:
a
When time a is in units of frames, the decoder 2 determines the reference time according to the following equation:
a. - [2] was a reference time (time a + (network delay × frame rate))
The network delay is time 4-time 3, that is, the difference between the current time when the decoder 2 receives the sync message and the time when the decoder 1 sends the sync message carried in the sync message. It should be noted that: when the reference time is in units of frames, the frame rates of the respective encoders are required to be the same.
F6: the decoder 2 decodes and outputs the live according to the determined reference time.
According to the process of the first embodiment of the invention, each slave decoder determines a new decoding reference according to the decoding reference of the master decoder and the network delay of the master decoder, and then decodes according to the decoding reference, so that the influence of the network delay on decoding synchronization is eliminated to a certain extent, and the decoding synchronization precision is improved.
Fig. 7 is a schematic diagram of a decoding synchronization process according to a second embodiment of the present invention. When the decoding synchronization period arrives, as shown, the process may include:
In a specific implementation, the process of electing the master decoder by each slave decoder may be: according to the buffer use condition of the decoder and the buffer use conditions of other decoders, the decoder with the maximum or minimum buffer use amount is selected as the main decoder of the decoding synchronization period. In general, the buffer usage of each decoder will not be exactly the same.
In the above flow, the network delay from each decoder to the main decoder may be determined based on an empirical value. A more accurate method is: each decoder carries the current time of sending the synchronous message in the synchronous message, so that other decoders calculate the network delay according to the current time of receiving the message and the time of sending the synchronous message by the decoder.
Because the network state may change, the buffer of the decoder 1 may be more in a certain period of time, and each decoder takes the decoding reference time of the decoder 1 as a reference; after a while, there may be more buffering in the decoder 2, and each decoder is based on the decoding reference time of the decoder 2. Each decoder autonomously determines a reference decoding reference time without manual intervention.
In the above flow, the decoding reference determined by the decoder may be the encoding time of the current frame, in this case, after the main decoder is elected, each decoder adds the network delay with the main decoder on the basis of the time determined by the main decoder to obtain the decoding reference. The decoding reference determined by the decoder may also be the number of the current frame, in which case, after the main decoder is elected, each decoder adds the product of the network delay with the main encoder and the frame rate to the frame number determined by the main decoder to obtain the decoding reference.
The video source code streams distributed to each decoder by the management server can have different priorities, and the priorities of the video source code streams of each decoder can be adjusted according to network conditions or service changes (such as the video source distributed to the decoder changes). Based on this, an alternative to the second embodiment is: when a decoding synchronization period arrives, each decoder sends a synchronization message to other decoders, wherein the synchronization message carries a decoding reference of the decoder, the current time of the decoder and the priority information of a code stream processed by the decoder; each decoder determines a main decoder of the synchronization period according to the priority information of the code stream carried in the received message and the priority of the code stream decoded by the decoder, then determines a decoding reference according to the decoding reference carried in the synchronization message sent by the main decoder and the network delay between the main decoder and the main decoder, and decodes according to the determined decoding reference. Wherein, each decoder can select the decoder with the highest or lowest priority of the code stream as the main decoder. The network delay calculation method and the method for calculating the decoding reference according to the decoding reference of the main decoder and the network delay from the main decoder are the same as the above description, and are not repeated herein.
Through the second embodiment of the present invention and the process of the alternative scheme thereof, it can be seen that each decoder elects a unified main decoder according to the memory usage, determines a new decoding reference according to the decoding reference determined by the main decoder and the network delay, and performs decoding according to the decoding reference, thereby eliminating the influence of the network delay on the decoding synchronization to a certain extent, and improving the decoding synchronization precision.
Based on the same technical concept, the embodiment of the present invention further provides a decoder applicable to the first embodiment. As shown in fig. 8, the decoder may include:
a first synchronization reference determining module 801, configured to determine, when the decoder is used as a main decoder and a decoding synchronization period arrives, a decoding reference according to a decoded current frame;
a synchronous packet sending module 802, configured to send a synchronous packet to the slave decoder when the present decoder serves as the master decoder, where the synchronous packet carries the decoding reference information determined by the master decoder;
a synchronous message receiving module 803, configured to receive a synchronous message sent by a master decoder when the local decoder serves as a slave decoder, where the synchronous message carries decoding reference information determined by the master decoder;
a second synchronization reference determining module 804, configured to determine, when the decoder is used as a slave decoder, a decoding reference according to the decoding reference information and network delay carried in the synchronization packet;
the decoding module 805 is configured to decode the received code stream when the local decoder serves as a master decoder, and decode the received code stream according to the decoding reference determined by the second synchronization reference determining module 804 when the local decoder serves as a slave decoder.
Further, the decoding reference determined by the first synchronization reference determining module 801 is the encoding time of the current frame, and the second synchronization reference determining module 804 is specifically configured to: and adding the network delay with the main encoder on the basis of the time indicated by the time information carried in the synchronous message to obtain a decoding reference. Alternatively, the decoding reference determined by the first synchronization reference determining module 801 is the number of the current frame, and the second synchronization reference determining module 804 is specifically configured to: and on the basis of the frame number carried in the synchronous message, adding the product of the network delay and the frame rate between the synchronous message and the main encoder to obtain a decoding standard.
Further, the synchronization packet also carries a time when the master decoder sends the synchronization packet, and the second synchronization reference determining module 804 is further configured to: and determining the network delay from the slave decoder to the master decoder according to the time for receiving the synchronous message and the time for sending the synchronous message by the master decoder carried in the synchronous message.
Based on the same technical concept, an embodiment of the present invention further provides a decoder applicable to the second embodiment and its alternatives, as shown in fig. 9, where the decoder may include:
a first synchronization reference determining module 901, configured to determine a decoding reference according to a decoded current frame when a decoding synchronization period arrives;
a synchronous packet sending module 902, configured to send a synchronous packet to another decoder, where the synchronous packet carries the decoding reference determined by the first synchronization reference determining module;
a synchronous message receiving module 903, configured to receive a synchronous message sent by another decoder, where the synchronous message carries a decoding reference determined by a decoder of a synchronous message sender;
a second synchronization reference determining module 904, configured to select a main decoder of the decoding synchronization period after the synchronization packet receiving module 903 receives synchronization packets sent by other decoders, and determine a decoding reference according to the decoding reference determined by the main decoder and a network delay;
and a decoding module 905, configured to decode the received code stream according to the decoding reference determined by the second synchronization reference module 904.
Further, the synchronization message also carries a cache use condition of the decoder, and the cache is used for caching the received code stream; accordingly, the second synchronization reference determining module 904 can select the primary decoder of the decoding synchronization cycle according to the buffer usage of the present decoder and the buffer usage of other decoders. Or, the synchronization message also carries the code stream priority information of the decoder; accordingly, the second synchronization reference determination module 904 can select the primary decoder of the decoding synchronization period according to the code stream priority of the present decoder and the code stream priorities of other decoders.
Further, the decoding reference determined by the first synchronization reference determining module 901 is the encoding time of the current frame; the second synchronization reference determining module 904 may add the network delay with the primary encoder based on the time determined by the primary decoder to obtain the decoding reference. Or, the decoding reference determined by the first synchronization reference determining module 901 is the number of the current frame; the second synchronization reference determining module 904 may add a product of a network delay and a frame rate with the primary encoder to obtain a decoding reference based on the frame number determined by the primary decoder.
Further, the synchronization message also carries the time for the decoder to send the synchronization message; the second synchronization reference determination module 904 may determine the network delay from the slave decoder to the master decoder based on the time of receiving the synchronization message sent by the master decoder and the time of sending the synchronization message by the master decoder.
In summary, in the above embodiments of the present invention, on one hand, the reference is synchronously encoded by each encoder, so that the encoding time points of each encoder are consistent; on the other hand: by taking network delay into account when determining the decoding reference, decoding synchronization is achieved. And, with the prior art effect, improve the synchronous precision of decoding.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present invention may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for enabling a terminal device (which may be a mobile phone, a personal computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and improvements can be made without departing from the principle of the present invention, and such modifications and improvements should also be considered within the scope of the present invention.
Claims (14)
1. A synchronous decoding method is applied to a video monitoring system and is characterized by comprising the following steps:
appointing a main decoder in a decoder in advance, and the rest are slave decoders;
when the decoding synchronization period is reached, the main decoder determines a decoding reference according to the decoded current frame and sends a synchronization message to the slave decoder, wherein the synchronization message carries the decoding reference information determined by the main decoder; the slave decoder determines a decoding reference according to the decoding reference information and network delay carried in the synchronous message, and decodes the received code stream according to the determined decoding reference;
the decoding reference determined by the main decoder is the encoding time of the current frame; the slave decoder determines a decoding reference according to the decoding reference information and the network delay carried in the synchronous message, and the method comprises the following steps: the slave decoder adds the network delay with the master decoder on the basis of the time indicated by the time information carried in the synchronous message to obtain a decoding reference; or
The decoding reference determined by the main decoder is the number of the current frame; the slave decoder determines a decoding reference according to the decoding reference information and the network delay carried in the synchronous message, and the method comprises the following steps: and the slave decoder adds the product of the network delay and the frame rate between the slave decoder and the master decoder on the basis of the frame number carried in the synchronous message to obtain a decoding standard.
2. The method of claim 1, wherein the synchronization message further carries a time when the primary decoder transmits the synchronization message;
after receiving the sync message from the decoder, the method further includes: and determining the network delay from the slave decoder to the master decoder according to the time for receiving the synchronous message and the time for sending the synchronous message by the master decoder carried in the synchronous message.
3. The method of claim 1, further comprising:
when the coding synchronization period arrives, each coder and the management server synchronize the coding reference of each coder; or each slave encoder and the master encoder synchronously encode the reference;
and each encoder carries out encoding according to the synchronized encoding reference and sends the encoded reference to a corresponding decoder.
4. A decoder for use in a video surveillance system, comprising:
the first synchronous reference determining module is used for determining a decoding reference according to a decoded current frame when the decoder is used as a main decoder and a decoding synchronous period is reached;
the synchronous message sending module is used for sending a synchronous message to the slave decoder when the decoder is used as a master decoder, wherein the synchronous message carries the decoding reference information determined by the master decoder;
the synchronous message receiving module is used for receiving a synchronous message sent by a main decoder when the decoder is used as a slave decoder, wherein the synchronous message carries decoding reference information determined by the main decoder;
a second synchronization reference determining module, configured to determine, when the decoder is used as a slave decoder, a decoding reference according to decoding reference information and network delay carried in the synchronization packet;
the decoding module is used for decoding the received code stream when the decoder is used as a master decoder, and decoding the received code stream according to the decoding reference determined by the second synchronous reference determining module when the decoder is used as a slave decoder; the decoding reference determined by the first synchronization reference determining module is the encoding time of the current frame; the second synchronization reference determining module is specifically configured to add a network delay with the main decoder to obtain a decoding reference based on a time indicated by time information carried in a synchronization message; or
The decoding reference determined by the first synchronization reference determining module is the number of the current frame; the second synchronization reference determining module is specifically configured to add a product of a network delay and a frame rate between the second synchronization reference determining module and the main decoder on the basis of a frame number carried in the synchronization packet to obtain a decoding reference.
5. The decoder of claim 4, wherein the synchronization message further carries a time when the primary decoder transmits the synchronization message;
the second synchronization reference determining module is further configured to determine a network delay from the slave decoder to the master decoder according to the time of receiving the synchronization packet and the time of sending the synchronization packet by the master decoder carried in the synchronization packet.
6. A synchronous decoding method is applied to a video monitoring system and is characterized by comprising the following steps:
when a decoding synchronization period arrives, each decoder determines a decoding reference according to a decoded current frame and sends a synchronization message to other decoders, wherein the synchronization message carries the decoding reference determined by the decoder;
after receiving the synchronous messages sent by other decoders, each decoder elects a main decoder of the decoding synchronous period, determines a decoding reference according to the decoding reference determined by the main decoder and network delay, and decodes the received code stream according to the determined decoding reference; wherein, the decoding reference determined by the decoder is the coding time of the current frame; determining a decoding reference according to the decoding reference determined by the main decoder and the network delay, wherein the method comprises the following steps: on the basis of the time determined by the main decoder, adding the network delay with the main decoder to obtain a decoding reference; or
The decoding reference determined by the decoder is the number of the current frame; determining a decoding reference according to the decoding reference determined by the main decoder and the network delay, wherein the method comprises the following steps: and on the basis of the frame number determined by the main decoder, adding the product of the network delay and the frame rate between the main decoder and the main decoder to obtain a decoding reference.
7. The method of claim 6, wherein the synchronization message further carries a cache usage of the decoder, and the cache is used for caching the received code stream; each decoder selects a main decoder of the decoding synchronization period according to the cache use condition of the decoder and the cache use conditions of other decoders; or,
the synchronous message also carries the code stream priority information of the decoder; each decoder selects the main decoder of the decoding synchronization period according to the code stream priority of the decoder and the code stream priority of other decoders.
8. The method of claim 7, wherein each decoder selects the decoder with the largest or smallest buffer usage as the main decoder of the decoding synchronization period according to the buffer usage of the decoder and other decoders.
9. The method of claim 7, wherein each decoder elects the decoder with the highest priority of the code stream as the master decoder for the decoding synchronization period based on the code stream priorities of the present decoder and the other decoders.
10. The method of claim 7, wherein the synchronization message further carries a time when the local decoder sends the synchronization message;
after the decoder elects the main decoder, the method also comprises the following steps: and determining the network delay from the decoder to the main decoder according to the time for receiving the synchronous message sent by the main decoder and the time for sending the synchronous message by the main decoder.
11. The method of claim 6, further comprising:
when the coding synchronization period arrives, each coder and the management server synchronize the coding reference of each coder; or each slave encoder and the master encoder synchronously encode the reference;
and each encoder carries out encoding according to the synchronized encoding reference and sends the encoded reference to a corresponding decoder.
12. A decoder for use in a video surveillance system, comprising:
the first synchronous reference determining module is used for determining a decoding reference according to a decoded current frame when a decoding synchronous period arrives;
the synchronous message sending module is used for sending a synchronous message to other decoders, wherein the synchronous message carries the decoding reference determined by the first synchronous reference determining module;
the synchronous message receiving module is used for receiving synchronous messages sent by other decoders, wherein the synchronous messages carry decoding standards determined by a synchronous message sender decoder;
a second synchronization reference determining module, configured to select a main decoder of the decoding synchronization period after the synchronization packet receiving module receives a synchronization packet sent by another decoder, and determine a decoding reference according to the decoding reference determined by the main decoder and a network delay;
the decoding module is used for decoding the received code stream according to the decoding reference determined by the second synchronous reference module; the decoding reference determined by the first synchronization reference determining module is the encoding time of the current frame; the second synchronization reference determining module is specifically configured to add a network delay with the main decoder to obtain a decoding reference based on the time determined by the main decoder; or
The decoding reference determined by the first synchronization reference determining module is the number of the current frame; the second synchronization reference determining module is specifically configured to, based on the frame number determined by the main decoder, add a product of a network delay and a frame rate between the second synchronization reference determining module and the main decoder to obtain a decoding reference.
13. The decoder of claim 12, wherein the synchronization packet further carries a cache usage of the decoder, and the cache is used for caching the received code stream; the second synchronization reference determining module is specifically configured to select a main decoder of the decoding synchronization cycle according to a buffer usage condition of the decoder and buffer usage conditions of other decoders; or,
the synchronous message also carries the code stream priority information of the decoder; the second synchronization reference determining module is specifically configured to select a primary decoder of the decoding synchronization period according to the bitstream priority of the current decoder and the bitstream priorities of other decoders.
14. The decoder of claim 12, wherein the synchronization message further carries a time when the local decoder transmits the synchronization message;
the second synchronization reference determining module is further configured to determine a network delay from the decoder to the main decoder according to the time of receiving the synchronization packet sent by the main decoder and the time of sending the synchronization packet by the main decoder.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110202743 CN102256128B (en) | 2011-07-12 | 2011-07-12 | Synchronous decoding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110202743 CN102256128B (en) | 2011-07-12 | 2011-07-12 | Synchronous decoding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102256128A CN102256128A (en) | 2011-11-23 |
| CN102256128B true CN102256128B (en) | 2013-07-24 |
Family
ID=44983075
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110202743 Active CN102256128B (en) | 2011-07-12 | 2011-07-12 | Synchronous decoding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102256128B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103200158A (en) * | 2012-01-06 | 2013-07-10 | 宏碁股份有限公司 | Method and system for playing multimedia series flow |
| KR101917174B1 (en) * | 2012-02-24 | 2018-11-09 | 삼성전자주식회사 | Method for transmitting stream between electronic devices and electronic device for the method thereof |
| CN103402140B (en) * | 2013-08-01 | 2016-12-28 | 深圳英飞拓科技股份有限公司 | A kind of method and system of the synchronous tiled upper wall of distributed IP Video Decoder |
| CN111031194B (en) * | 2019-12-12 | 2022-05-17 | 北京东土科技股份有限公司 | Multi-channel decoder synchronization control method, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6556252B1 (en) * | 1999-02-08 | 2003-04-29 | Lg Electronics Inc. | Device and method for processing sub-picture |
| CN1543193A (en) * | 2003-03-31 | 2004-11-03 | 索尼英国有限公司 | Video synchronization |
| US20050180511A1 (en) * | 2004-02-13 | 2005-08-18 | Kabushiki Kaisha Toshiba | H. 264 codec IC, DVD playback apparatus, H. 264 codec method |
| CN101271720A (en) * | 2008-04-22 | 2008-09-24 | 中兴通讯股份有限公司 | Synchronization process for mobile phone stream media audio and video |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002223434A (en) * | 2001-01-26 | 2002-08-09 | Canon Inc | Video monitoring system and video monitoring method |
-
2011
- 2011-07-12 CN CN 201110202743 patent/CN102256128B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6556252B1 (en) * | 1999-02-08 | 2003-04-29 | Lg Electronics Inc. | Device and method for processing sub-picture |
| CN1543193A (en) * | 2003-03-31 | 2004-11-03 | 索尼英国有限公司 | Video synchronization |
| US20050180511A1 (en) * | 2004-02-13 | 2005-08-18 | Kabushiki Kaisha Toshiba | H. 264 codec IC, DVD playback apparatus, H. 264 codec method |
| CN101271720A (en) * | 2008-04-22 | 2008-09-24 | 中兴通讯股份有限公司 | Synchronization process for mobile phone stream media audio and video |
Non-Patent Citations (1)
| Title |
|---|
| JP特开2002-223434A 2002.08.09 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102256128A (en) | 2011-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104918133B (en) | A kind of playing method and device for regarding video flowing in networking | |
| CN107360443A (en) | A kind of cloud desktop picture processing method, cloud desktop server and client | |
| CN101895750A (en) | Set-top box and PC-oriented real-time streaming media server and working method | |
| CN104735470A (en) | Streaming media data transmission method and device | |
| CN110662100A (en) | Information processing method, device and system and computer readable storage medium | |
| CN101951387A (en) | Method and device for transmitting stream media | |
| CN102256128B (en) | Synchronous decoding method and device | |
| CN103002354A (en) | Method and system for eliminating network jitter of video data during transmission | |
| CN110519635A (en) | A kind of audio-video frequency media stream interflow method and system of wireless clustered system | |
| CN103686203A (en) | Video transcoding method and device | |
| CN112616065A (en) | Screen image initiating method and device, computer equipment, readable storage medium and screen image presenting system | |
| CN103269433A (en) | Video data transmission method and video data transmission system | |
| CN104683823A (en) | Multi-screen linked audio and video synchronizing system | |
| CN113891132A (en) | Audio and video synchronization monitoring method and device, electronic equipment and storage medium | |
| EP2643977B1 (en) | Method and apparatus for processing a video signal | |
| CN106603518A (en) | Time stamp generating method and time stamp generating device of real-time transmission protocol system | |
| WO2010021665A1 (en) | Hypothetical reference decoder | |
| CN107360424A (en) | A kind of bit rate control method based on video encoder, device and video server | |
| CN103826084A (en) | Audio encoding method | |
| CN113973224A (en) | Method for transmitting media information, computing device and storage medium | |
| CN117834989A (en) | End cloud asynchronous rendering method based on virtual reality scene | |
| Haiyan et al. | Application of SVGA video real-time transmission technology in music education information communication | |
| CN113242446B (en) | Video frame caching method, video frame forwarding method, communication server and program product | |
| CN104935923A (en) | Signal encoding method and system, and signal decoding method and system | |
| CN112153322B (en) | Data distribution method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: ZHEJIANG UNIVIEW TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: HUASAN COMMUNICATION TECHNOLOGY CO., LTD. Effective date: 20120217 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20120217 Address after: Hangzhou City, Zhejiang province 310053 Binjiang District Dongxin Road No. 66 building two or three layer A C Applicant after: Zhejiang Uniview Technology Co., Ltd. Address before: 310053 Hangzhou hi tech Industrial Development Zone, Zhejiang province science and Technology Industrial Park, No. 310 and No. six road, HUAWEI, Hangzhou production base Applicant before: Huasan Communication Technology Co., Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |